APPARATUS FOR AND METHOD OF PATTERN 
RECOGNITION AND IMAGE ANALYSIS 



RELATED APPLICATIONS 

[0001] This application is a continuation-in-part (CIP) of U.S. Patent 
Application Serial Number 10/144,754 filed May 15, 2002 which claims priority to 
United States Provisional Patent Application Serial No. 60/291,000, filed on May 16, 
2001. 

FIELD OF THE INVENTION 

[0002] The present invention is directed to methods of and systems for 
information processing, information mapping, pattern recognition and image analysis 
in computer systems. * * 

BACKGROUND 

[0003] With the increasing proliferation of imaging capabilities, information 
transactions in computer systems increasingly require the identification and 
comparison of digital images. In addition to, conventional viewable digital images, 
other types of information, both viewable and non-viewable, are subject to pattern 
analysis and matching. Image identification and pattern analysis/recognition is 
usually dependent on analysis and classification of predetermined features of the 
image. Accurately identifying images using a computer system is complicated by 
relatively minor data distorting the images or patterns resulting from changes caused 
when, for example, are shifted, rotated or otherwise deformed. 

[0004] Object invariance is a afield ; ^ of- visual analysis which deals with 
recognizing an object despite distortion such as that caused by shifting, rotation, other 
affine distortions, cropping, etc. Object invariance is used primarily in visual 
comparison tasks. Identification of a single object or image within a group of objects 
or images also complicates the image identification process. Selective attention, or 
"priming", deals with how a visual object can be separated from its background or 
other visual objects comprising distractions. 
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[0005] Current pattern recognition, image analysis and information mapping 
systems typically employ a Bayesian Logic. Bayesian Logic predicts future events 
through the use of knowledge derived from prior events. In computer applications, 
Bayesian Logic relies on prior events to formulate or adjust a mathematical model 
used to calculate the probability of a specific event in the future. Without prior events 
on which to base a mathematical model, Bayesian Logic is unable to calculate the 
probability of a future event. Conversely, as the number of prior events increases, the 
accuracy of the mathematical model increases as does the accuracy of the resulting 
prediction from the Bayesian Logic approach. 

[0006] Currently, two common paradigms accommodating some degree of 
distortion (i.e., image deformation) of a visual object under deformations; point-to- 
point mapping and high order statistics. Point-to-point, or matching with shape 
contexts, achieves measurement stability by identifying one or more sub-patterns with 
the overall patterns or images being compared. Once these sub-patterns are identified, 
the statistical features of sub-patterns are compared to determine agreement between 
the two images. Point-to-point mapping methodologies are further described in 
"Matching with Shape Contexts" by Serge Belongie and Jitendra Malik in June, 2000 
during the IEEE Workshop On Content-based Access of Image and Video Libraries 
(CBAIVL). A second method of point-to-point mapping is what/where networks and 
assessments of lie groups of transformations based on back propagation networks. In 
this method an optimal transformation is identified for a feature in a first image and is 
used to compare the same feature in a second amage. This approach deconstructs the 
image into a sum or a multiplicity of functions. These functions are then mapped to 
an appropriately deconstructed image function of a compared, or second image. 
What/where networks have been used by Dr. Rajesh Rao and Dana Ballard from the 
Salk Institute in La Hoya, California. The point-to-point mapping techniques 
described attempt to map a test or input image to a reference or target image that is 
either stored in memory directly or is encoded into memory. The point-to-point 
approach achieves limited image segmentation and mappings through the use of a 
statistical approach. 
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[0007] In the high order statistical approach both the original input image 
and the compare target image are mapped into a high dimensional space and statistical 
measurements are performed on the images in the high dimensional space. These 
high order statistical measurements are compared to quantity an amount of agreement 
between the two images indicative of image similarity. This approach is used by 
Support Vector Machines, High Order Clustering (Hava Siegelmann and Hod Lipson) 
and Tangent Distance Neural Networks (TDNN). Support Vector Machines are 
described by Nello Christianini and John Shawe-Taylor ISBN 0-521-78019-5. 

[0008] Both the point-to-point mapping and the high order statistics 
approach have been used in an attempt to recognize images subject to various 
transformations due to shifting, rotation and other deformations of the subject. These 
approaches are virtually ineffective for effectively isolating a comparison object 
(selective attention) from the background or other visual objects. 

[0009] In contrast to these two common paradigms, the human brain may 
compare two objects or two patterns using "insight" without the benefit of prior 
knowledge of the objects or the patterns. A Gestalt approach to comparing objects or 
comparing patterns attempts to include the concept of insight by focusing on the 
whole object rather than individual portions of the object. Gestalt techniques have not 
been applied to computer systems to perform pattern recognition, image analysis or 
information mapping. Gestalt mapping is further described in Vision Science- 
Photons to Phenomenology by Stephen E. Plamer, ISBN 0-262-16183-4. 

SUMMARY 

[0010] According to one aspect of the present invention, a method of 
comparing an input pattern with a memory pattern comprises the steps of loading a 
representation of said input pattern into cells in an input layer; loading a 
representation of said memory pattern into cells in a memory layer; loading an initial 
value into cells in an intermediate layers between said input layer and said memory 
layer; comparing values of cells in said intermediate layers with values stored in cells 
of adjacent layers; updating values stored in cells in said intermediate layers based on 
said step of comparing; and mapping cells in said memory layer to cells in said input 
layer. 
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BRIEF DESCRIPTION OF THE FIGURES 

[0011] FIGURE 1 shows a flow diagram of one embodiment of the 
transformation engine data processing of the present invention; 

[0012] FIGURE 2 shows an embodiment of the present invention including a 
one dimensional numeric transformation engine which may be used to map time 
dependent curves; 

[0013] FIGURE 3 A is a one dimensional, time dependent curve representing 
an input pattern; 

[0014] FIGURE 3B is a one dimensional, time dependent curve representing a 
memory pattern; 

[0015] FIGURE 3C shows the one dimensional, time dependent curves 
representing superimposed input and memory patterns; 

[0016] FIGURE 3D shows the one dimensional, time dependent curves 
representing the layers within a matrix during the early stages of top-down and 
bottom-up wave traversal; 

[0017] FIGURE 3E shows the one dimensional, time dependent curves 
representing an advanced stage top-down and bottom-up wave traversal; 

[0018] FIGURE 4 shows the structure of a one-dimensional numerical 
transformation engine including a top-down and bottom-up wave propagation 
approach of one embodiment of the present invention; 

[0019] FIGURE 5 shows a screen shot of a mapping between a stored 
signature and input signature with corresponding points connected by line segments; 

[0020] FIGURE 6 represents another embodiment of the present invention 
which may be used to implement selective attention filtering of noise; 

[0021] FIGURE 7 shows a two-dimensional hexagonal implementation of a 
transformation engine according to an embodiment of the invention; 
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[0022] FIGURE 8 is an illustration of either the input short term or long term 
memory in which metal electrodes that are located in the middle of each pixel are 
each fed with a different alternating or constant voltage at different frequencies; 

[0023] FIGURE 9 shows an illustration of a mathematical model of one 
embodiment of the transformation engine; 

[0024] FIGURE 10 shows how a disk filled of"-" signs may be mapped to a 
disk filled with "+" signs in a comparison of images; 

[0025] FIGURE 1 1 shows the interaction between the input layer and the 
memory layer within a transformation engine; 

[0026] FIGURE 12 shows one embodiment of a unit or cell used in an 
embodiment of the transformation engine; 

[0027] FIGURE 13 shows a spherical cell of a solid transformation engine 
including a colloid with suspended dipolar media units; 

[0028] FIGURE 14 shows a transformation engine including a liquid media 
suspending or including dipolar media units according to an embodiment of the 
present invention; 

[0029] FIGURE 15A shows the cyclic structure of the S, S+l, and S+2 nature 
of the three layers of a dipolar transformation engine; 

[0030] FIGURE 15B shows the top layer, S, of the dipolar transformation 

engine; 

[0031] FIGURE 16 shows the orientation of the layers when the distance of 

1 

each vertex from the heights intersection is — = 

V3 

[0032] FIGURE 17 shows a flow diagram of another embodiment of the 
transformation engine data processing of the present invention. 
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DETAILED DESCRIPTION 

[0033] The following terms and their definitions are provided to assist in the 
understanding of the various embodiments of the present invention. 

(1) Hierarchical Zooming as used in Multi-resolution Analysis and further 
explained in "Introduction to Wavelets and Wavelet Transforms", A 
Primer, C. Sidney Burrus, Ramesh A. Gopinath, Haitao Guo, Prentice 
Hall ISBN 0-13-489600-9 Chapter 2 page 10, A Multi-resolution 
Formulation of Wavelet Systems and "a Wavelet tour of signal 
processing" - Stephane Mallat ISBN 0-12-466606-X page 221. 

(2) Ebbing resonance, Relaxation process as used in Simulated Annealing 
and further explained in Adaptive Cooperative Systems, Martin 
Beckerman, ISBN 0-471-01287-4, Chapter 7, page 253, The approach 
to equilibrium, 7.1.1 Relaxation and Equilibrium Fluctuations. 

See also "Simulated Annealing" at Chapter 4, page 108. In connection 
with a transformation engine according to the present invention, 
simulated annealing results in a gradual reduction of the values of 'R' 
fi K' and 'a 5 over time. 

(3) Intensity of Resonance means the value of the learning rate or update 
rate 0<R<1 such that if R is close to 1 then the "Resonance is Strong", 
and for 128 layers when R > 0.955 then the Resonance is considered as 
"strong". 

(4) Multi-level matrix refers to a transformation engine in which each 
cell/unit/pixel can hold more than one value at the time and in which 
these different values are used at different phases of the algorithm. For 
example, a one-dimensional transformation engine stores (x,y) values 
in its cells/units/pixels. An additional (xi,yi) vector can also be stored. 

(5) Euclidean distance (between (x,y,z) and (xi,yi,zi)= square root of 
((x-xO^Cy-yOVCz-z,) 2 ). 

(6) Far Differentials refer to Far Span k-Distance Connections such that, 
given 4 values of 4 pixels, pl,p2,ql,q2 such that pl,p2 are on one layer 
and ql,q2 are on an adjacent layer, let K be the distance between the 
pi and p2 and the same distance between ql and q2, then the Far Span 
k-Distance Connection between the 4 values is (p2-pl)-(q2-ql), such 
that the value pi is in pixel (ii ji,S), the value p2 is in pixel (i2j2,S), the 
value ql is in pixel (i3,j 3 ,S+l) and the value q2 is stored in pixel 
(i 4 ,j4,S+l). K means that the square root of (ii- ii) 2 + (j i-j 2 ) 2 is K and 
that also the square root of (i 3 - u) 2 + (j 3-j4) 2 is also K. In a one 
dimensional transformation engine instead of having two indices (i, j) 
in each layer we have only one index. 
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(7) Energy, including the phrase "a more complex energy function", refer 
to a function minimized by a transformation engine according to an 
embodiment of the invention. The Energy function may be expressed 
by following integral in a two dimensional transformation engine, 

JJ|(VP • VP + K(VVP • VP) • (VVP • VP) + Optional)dx dy dz 
x,y,z 

given pixel (x,y) at layer z for a scalar energy P. 

If each pixel holds a vector V instead of a scalar P then the gradient of 
P is replaced by the vector V and the second gradient of P is replaced 
by the gradient of V. 

Then the energy / Action integral takes the 
form, JJJ(\/ • V + K(V V • V) • (W • V) + Optional)dx dy dz 
x t y t z 

The General Relativistic tensor form of the energy function may be 
expressed as: 

HP.m P.k 9 mk +Kg Lk (P,j gi n (P, k ,n j^P.u ><P.J 9 jn (P.L -n-{^}p.u hf 7 *** 

= J(P.m P> m +K P, n P, k ; n P. m P> k ; m 7^9 dCl 
Q 

where gkm is Einstein's metric tensor and the term \ U > is the 

[knj 

Christoffel symbol. The General Relativistic energy function is a 
model of the cosmos as a transformation engine in equilibrium. 

(8) Distance function is a function D that receives two points and 
calculates a value. For example the two points (x,y), (xi,yi) and the 

functions >' or 

D((x,y),(x,,y 1 )) =^(x- Xl ) 2 +(y-y { ) 2 

(9) Radial basis decay function is a function g that is reduced with the 
distance from a given point (xo,yo). For example 

-(x-x ) 2 -(y-y ) 2 
g(x,y) = e u u 



(10) Convolution Scale is a convolution with a Radial basis decay function 
such that the distance from the point x 0 ,yo (refer to definition 9 above) 
is divided by a constant s terminal the scale factor: 
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-(x-x Q ) 2 ^(y-y 0 ) 2 

g(x,y) = e 

This function is the same as in 9 but the distance 

7(x-Xi) 2 +(y-yi) 2 is divided by S. The square distance is divided 
by S 2 . 



(11) Pattern degeneracy, in connection with symmetry, if the derivative of a 
potential function p vanishes in a domain D then P is degenerated in D; 
and in connection with a multidimensional manifold, such as the 4 
dimensional manifold (x,y,z,t,p(x,y,z,t)), wherein p depends on the 
other coordinates, one can consider the Gaussian curvature of the 
manifold, such that, if the curvature is 0 in the domain D, then the 
potential p is said to be degenerated on D. The last definition is 
appropriate only if x,y,z,t define and Euclidean space . 



(12) Potential is a function that depends on coordinates and is a scalar 
value. 

Scalar value means that the function calculates a directionless numeric 
. value and not a vector. Thus, a generic potential is a function that 
calculates a value with no dimensions, such as the coulomb potential, 2 
inches is a value with the dimension of length, 

q 



p(x,y,z,t)= 



V(x-x 0 ) 2 +(y-y 0 ) 2 +(z-z 0 ) 2 



(13) Hebbian learning and Hebbian learning rate means that, if a Unit(s,t) is 
updated towards a new data vector V then the new value of Unit(s,t) 
will be, (l - R) • Units(s, t) + R-V such that R<1 where R is the 
Hebbian learning rate. 

(14) Updates refer to an update of a value or vector v towards the value or 
vector u, the value r*(u-v) such that r is the resonance rate added to v, 
or v(n+l)=v(n)+r*(u(n)-v(n)). 

(15) Resonance rate refers to the Hebbian rate at which a unit is updated 
towards a "winning" unit in an adjacent layer. The resonance rate V or 
'R' is a number between 0 and 1 not including 0 and 1, i.e., 0<r<l. 

(16) Move Towards Winner refers to a competition, such that, suppose that 
n vectors V } ,V 2 ,...V n are checked against a vector U to determine 
which is closest to U in Euclidean coordinates. Further, suppose that 
1^. - lj\ is the minimum norm for some 0<j<n=l. Then if the value r* 
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(Vj - I/) such that 0<r<l is added to U then U is said to Move 
Towards the Winner V } . 

(17) Winner Takes All refers to a competition, such that, suppose that n 
vectors V x , V 2 ,...V n are checked against a vector U which is closest to U 

in Euclidean coordinates. Further, suppose that |f\ -£/| is the 
minimum norm for some 0<j<n+l, then if the value r* (u - Vj ) such 
that 0<r<l is added to V } then V j is said to be the Winner That Takes 
AIL 

(18) Ebbing Resonance refers to a relaxation process, wherein "relaxation" 
is used with the same meaning as in non - linear optimization theory. 
Relaxation typically involves a gradual reduction parameters such as 
heat, noise, peak to peak alternating current amplitude, speed, learning 
rate, electric field intensity, etc. The word "resonance" is used in the 
same way that it is used in ART (Adaptive Resonance Theory) as 
articulated by Professor Stephen Grossberg. 

(19) Euclidean Distance is the distance between a vector V and a vector U 
that is the norm of the difference V - U in R w , 



\V - U\ = ^1£j( v i ~ u if such that i is the index of the i th dimension of 
the vectors V and U. 

(20) Far Differential refers to a Far Span K Distance Connection, such that 
the Far Differential - Far Span K Distance Connection between a 
Units(s,t) and Unit(s,t+k) is Unit(s,t+k)-Unit(s,t) and between Unit(s,t- 
k) and Unit(s,t) it is Unit(s,t-k)-Unit(s,t). 

(21) Hexagonal Coordinates refers to a hexagonal matrix having the 
following indices, for an even row, 0, 2, 4, 8, . . ., 2n. For an odd row, 
1, 3, 5, 7, . . . 2n+l. For example the following unit is valid 
Unit(s,30,30) and Unit(s,30,31) is invalid. Indices are used like the 
row and column indices in matrices in Linear Algebra. 

(22) Hexagonal Neighbors (two-dimensional) defined such that the 
Hexagonal neighbors of the unit Unit(s,w,t) are Unit(s,w+l,t+l), 
Unit(s,w+l,t-l), Unit(s,w-l,t+l), Unit(s,w-l,t-l), Unit(s,w,t+2), 
Unit(s,w,t-2). 

(23) Hexagonal Far Differentials refers to Far Span K Distance Connections 
(two-dimensional), such that for a valid unit Unit(s,w,t) there are 6 
such Far Differentials as follows, Unit(s,w,t) - Unit(s,w+k,t+k), 
Unit(s,w,t) - Unit(s,w+k,t-k), Unit(s,w,t) - Unit(s,w-k,t+k), Unit(s,w,t) 
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(24) 
(25) 



(26) 
(27) 



- Unit(s,w-k,t-k), Unit(s,w,t) - Unit(s,w,t+2k), Unit(s,w,t) - 
Unit(s,w,t-2k). 

'k' Parameter is defined by Far Differential - Far Span K Distance 
Connection and Hexagonal Far Differentials - Far Span K Distance 
Connections. 

6 a' Parameter refers to a number that changes during the ebbing 
resonance numeric process. Instead of calculating the distance 
between the units U(s,t) and U(s,t-1) as \U(s 9 t) -U{sj + 1)| the 
distance function uses Far Differentials as follows, 

Distance(U(s,t), U(s+l,t+l)) = \U(s,t) - U(s + U + 1)| + 
a* \U(s,t + k)-U(s,t) -U(s + U + 1 + k) + U(s + U + + 
a*\U(s,t-k)-U(sJ)-U(s + U + l-k) + U(s + l 9 t + l)\. 

Distance(U(s,t), U(s+ 1 ,t- 1 )) = \U(s 9 1) -U(s + l,t- 1)| + 
a* \U(s 9 t + k)- U(s y t)-U(s + l,t-\ + k) + U(s + l,t- 1)| + 
a* \U(s,t- k) - U(s 9 t) -U(s + \ 9 t-\-k) + U(s + U- 1)| . 

Distance(U(s,t), U(s+l,t)) = \U(s,t) - U(s + U)| + 
a* \U(s, t + k)-U(s,t)- U(s + 1, / + k) + U(s + 1, *)| + 
a* \U(s, t-k)-U(s,t)- U(s + U-k) + U(s + 1, t)\ . 

Using the Hexagonal Far Differential obtains a sum of 7 Euclidean 
terms in which six of them are multiplied by the V parameter. 

Convolution (of a scalar or a vector function G which is defined on the 
domain D with a function f at the point X) is defined as, 

Convolution^, X) = $G(Z)*f(Z-X) dZ 



Hierarchical Zooming means an Ebbing Resonance process in which 
the 'k' parameter either in the one-dimensional numeric 
Transformatron or in the Two Dimensional Hexagonal Transformatron 
Far Differentials is gradually reduced. The term Hierarchical Zooming 
also refers to a convolution with Radial Basis Decay function such that 
the convolution integral takes the form, 



In this formula, R(t) is called Radial Scale and it is gradually reduced 
with the time t. 
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(28) Convolution Scaling refers to a function R(t) which is defined in the 
Hierarchical Zooming. 

(29) Radial Basis refers to a function f(Z) is considered as a Radial Basis 
function if and only if f(z) = ui\z\) such that u is a function that 
depends only on the norm of Z. 

(30) Radial Basis Decay refers to a function of the form, f(z) = u(\z\) and 
that the following conditions hold, 

J /(z)rfZ<oo A (z^oo)^>/(z)^0. 

If the domain D is finite then the first condition holds. 

(31) Clue Oriented Mapping [of two patterns f, g] is illustrated as follows. 
Let f and g denote bounded analytic real functions that are defined on 
open connected domains D f and D g such that there is a map 

F-D f+Dg yp^D f (p) f Determinant(F)*0 

and F is globally onto and one to one. If the domains are finite sets in 
R n then we are done otherwise there is another requirement that the 

source of each compact set in £) g should also be compact. This 

mapping F is called Proper in the mathematics (theory of Differential 
Topology). 

We also require that Vpe £> y (p),g\F\jty=f(j>) • A proper map 
that minimizes the following J C^^Tp^' -K* z J dz such that K is 

the Gaussian Curvature of the manifolds D f ,f and D g ,g respectvely is 

defined Clue Oriented. C is a function that defines how the system 
responds to curvature mismatches. Example for C is C(x) = log(l+k). 

(32) Degenerated Pattern refers to pattern degeneracy, wherein a 
degeneration pattern is a function f that is defined on a domain D f 

such that there exists an open set Q such that the Gaussian curvature K 
of the manifold D f ,f on Q is 0. 

(33) Degree of Freedom refers to a condition in which more than one 
possible solution can be reached. 
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(34) Phase Lag refers to the time from the moment a particle is placed in an 
electric field until it gains most of its induced dipole, say 0.9 of the 
final dipole. 

[0034] One embodiment of present invention provides a "transformation 
engine" that incorporates a Gestalt approach to image comparisons, pattern 
recognition and image analysis. The present invention may be used to create a point- 
to-point mapping or a point-to-point map between an input pattern and a stored 
pattern (for convenience of explanation together referred to as two visual objects 
although applicable to other data having or representative of a pattern). This point-to- 
point mapping may be implemented by performing a transformation between the two 
visual objects and creating a multi-layered gradual transition between the input 
pattern and the stored or memory pattern. The point-to-point mapping is performed 
by Resonance as defined hereinabove. Thus, Resonance is used to construct a 
transformation between the two visual objects using a multi-layered gradual 
transition. This multi-layered entity according to one embodiment of the invention 
constitutes a matrix formed of a plurality of layers. Each layer, within the multi- 
layered approach, maintains the topological features of each of the two visual objects. 
That is, intermediate layers maintain and exhibit characteristics common to the two 
visual objects such that significant features of the pattern are recognizable. As the 
number of layers increases, the difference between two adjacent layers is reduced. 
While this embodiment of the present invention does not explicitly minimize the 
global "energy" function, the embodiment may achieve a Gestaltist energy 
minimization of a transformation between the two visual objects. 

[0035] Energy minimization is a consequence of the structure of the 
transformation engine of the embodiment. Energy minimization may be effected by 
an information "smearing" procedure, which causes a migration of data through the 
matrix to achieve a minimized energy potential between layers. Transitions between 
layers may be created by providing "waves" of modifying functions. Two waves, a 
top down wave and a bottom up wave, may be used to create a Gestalt transformation 
between the two visual objects. The input pattern may be stored in the input layer or 
the short term memory (STM) layer and the stored "reference" or "target" pattern 
may be stored in the memory layer or the long term memory (LTM) layer. The 
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transformation engine of the present invention achieves the point-to-point mapping 
between the two visual objects without either directly or indirectly calculating 
statistical values. Once the point-to-point association between the two visual objects 
is achieved, stable statistical measurements may be calculated to determine the 
amount of agreement between the two visual objects. This embodiment of the present 
invention may be used for comparing patterns of visual objects (a comparison mode) 
and for isolating an object from the surrounding background or other objects 
(selective attention task). 

[0036] The transformation engine of the present invention includes or operates 
in two phases. In the first phase the transformation engine builds a map between the 
LTM (referenced or target image) pattern and the STM (input pattern under 
examination) pattern. In the second phase, the transformation engine uses "vibration" 
waves to turn the map created into either an explicit point-to-point mapping or into an 
explicit pattern recognition engine. The vibration waves cause the intermediate layers 
to maintain a low energy state while encouraging conformance to LTM and STM 
patterns based on distance from such. 

[0037] The map created by the transformation engine may be created in a 
number of ways, each of which is included in the present invention. In one 
embodiment the map may be created by digital means, e.g., a digital computer. In 
another embodiment the map may be created by physical means, i.e., incorporating a 
media responsive to patterned conditions so as to provide a transition between 
patterns, such as by placing elongated pieces of conducting material within an 
electric field such that the conducting material becomes aligned within the electric 
field. Other means of creating the mapping from the LTM pattern to the STM pattern 
are also included within the present invention. 

[0038] During the second phase of operation of the transformation engine, 
vibration waves cause the intermediate values in the intermediate layers -between the 
LTM and the STM layers to oscillate which prevents the transformation engine from 
permanently storing local minimum of the corresponding Action Integral within the 
intermediate layers. In other words, the transformation engine is aimed at eliminating 
the Variation of the (static) Action Integral: 
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0 = 5 JJj( VP • VP + AX V VP • • ( v V ^ • V p ) + Optional)dx dy dz 

x,y,z 

Where LTM = P(X,Y,0) and STM = P(X,Y,1). 

[0039] The elimination of the variation of the Action Integral means that the 
potential p maintains up to second order derivatives as the pattern that is encoded by p 
changes from one layer to the next adjacent layer. Convergence in a digital 
implementation where neither a real potential nor its gradient (the induced vector 
field) may be achieved through digital means, i.e., by use of a digital representation of 
the vector field using for example, a mathematical model to be explained below. In a 
preferred embodiment, the transformation engine forces values to change in the 
intermediate layers through the use of a learning rate (R) that is typical to concurrent 
neural networks approach. In this embodiment, if P(S) represents the value stored in 
an intermediate layer, and it is desired to change P(S) into a new value W then the 
learning rate 0<R<1 defines the learning paradigm, P ne w(S)=(l-R)*P 0 id(S)+R* W. If 
R is close to 1 then the learning process is rapid but relatively unstable. The reduction 
of this parameter from 0.995 to 0.835 with the number of layers is 128 along with the 
reduction of the Far Span k-Distance Connections (a) is a way to minimize the Action 
Integral. In a "real" physical system, i.e., one relying on some physical property of a 
component of the system, neither the learning rate nor the Far Span K-Distance 
Connection would be necessary. 

[0040] A digital implementation of the comparison mode of the present 
invention will be described first. 

[0041] FIGURE 1 shows a flow diagram of one embodiment of a 
transformation engine data processing of the present invention. In Step 101 an input 
pattern is loaded into the input layer or "short term memory" (STM) layer. Note that 
the input or STM layer may be represented by or stored in either the top most layer of 
the matrix or the bottom most layer of the matrix. For ease of explanation, the input 
layer will be defined as the top most layer of the matrix. In Step 102 the memory 
pattern is loaded into the memory layer or long term memory (LTM) layer. The 
memory or LTM layer may also be the bottom-most layer or the top-most layer 
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opposite the STM layer. That is, the memory layer should be at the opposite end of 
the matrix from the input layer. For ease of explanation, the memory layer will be 
defined as the bottom most layer of the matrix. 

[0042] In Step 103 data values representing some pattern to be identified (e.g., 
an input image) are stored in the input layer and copied into each level of the top or 
upper half of the multiple layers. Similarly, in Step 104 data values representing 
some previously stored pattern are stored in the memory layer and copied into each 
level of the lower or bottom half of the matrix. Steps 103 and 104 provide the cells of 
the inner layers of the matrix with initial data values to initialize the matrix. In Step 
105 a top-down "wave" and a bottom-up :wave: are promulgated through the multi- 
layer matrix as further described below. When Step 105 is performed during a 
comparison mode, the values in the input layer and the memory layer are held 
constant, but the initial values stored in each of the inner layers of the matrix may be 
adjusted to provide a gradual transition of pattern data between layers. During this 
step the "intensity" of the waves is gradually reduced, i.e., the magnitude of change 
between layers is gradually reduced, as is the span of data checked as the method 
progresses towards convergence and energy minimization. This reduction in the 
intensity of the waves occurs in the first phase of the transformation engine when a 
map is constructed between the LTM and the STM pattern. Ebbing Resonance is also 
performed in Step 105 as further described below. The values in each of the layers 
are held constant in Step 106 and a one-to-one mapping is performed in Step 107 
between the input layer and the memory layer. 

[0043] Various methodologies may be used to perform this one-to-one 
mapping including sequentially sending a single wave for each input cell and 
determining, based on the single wave, the best matching memory cell In this case, 
for each pixel of the STM input board/layer represented by (i, j) the value of the pixel 
(i j) is oscillated or varied over a predefined range while the value for all other pixels 
(i.e., data elements of the pattern) of the STM board are held constant. This process is 
repeated serially for each one of the pixels of the STM board. The best matching 
memory cell using this methodology is the memory cell which receives the strongest 
vibration wave from the single wave applied to the input cell. Once the best matching 
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memory cell is identified, the corresponding input cell is mapped to the memory cell. 
Alternatively, a coherent vibration wave may be sent from all of the cells in the input 
layer and spectral analysis of the wave may be performed to determine the 
associations between input cells and memory cells. This second methodology creates 
a vibration wave pattern in each of the memory cells which is a superposition of small 
ripple vibration waves. By measuring and performing spectral deconstruction on the 
resulting pattern in the memory layer, a Bayesian pattern may be identified. 

[0044] FIGURE 2 shows an embodiment of the present invention which 
includes a one dimensional numeric transformation engine which may be used to map 
time dependent curves. FIGURE 3A is a one dimensional, time dependent curve 
which is represented by input pattern 301. FIGURE 3B is a one dimensional, time 
dependent curve which is represented by memory pattern 302. As discussed in 
connection with Step 101, initially, data representing the input signal curve is loaded 
into the input layer 201, which is represented by the "y" coordinates {e.g., sampling 
points or times) from FIGURE 3 A which are thereby contained within layer 201. 
Preprocessing may also be performed on the values prior to storage in input layer 201. 
The memory curve is loaded into memory layer 202 as discussed in connection with 
Step 102 and as shown in layer 202 of FIGURE 2. The "y" coordinates from 
FIGURE 3B are contained in layer 202. Preprocessing may also be performed on the 
values before they are stored within memory layer 202. Initially, each of the cells of 
layers 203 and 204 contain the same values in each of the respective cells of the layers 
as layer 201 as shown in FIGURE 2 and as described in Step 103. Similarly, as shown 
in layers 205 and 206, the "y" coordinates from the cells in memory layer 202 are 
copied into the respective cells for layers 205 and 206 and as described in Step 104. 
FIGURE 3C shows the one dimensional, time dependent curves which represent input 
pattern 301 and memory pattern 302 superimposed. As can be seen, while the general 
form of the two patterns or signals are similar, each differs from the other in specifics. 

[0045] Once each layer of the matrix stores initial values, Step 105 is 
performed and both top-down and bottom-up waves are passed alternately through the 
matrix. The top-down and bottom-up waves may modify the values stored in each of 
the cells to form a mapping between layers. (Note that, in a comparison mode, the 
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values in the cells in the input layer and the memory layer remain constant through 
the comparison.) Also in Step 105, an ebbing resonance process is applied to the 
multi-level matrix. The ebbing resonance process is a relaxation process that achieves 
convergence via hierarchical zooming. In a preferred embodiment, both the intensity 
of the resonance and the radius at which differences between a cell and its 
neighboring cells are checked and gradually reduced. The complete ebbing resonance 
uses convolutions and time varying patterns in a top-down and a bottom up approach 
alternately. The convolutions, as described more fully below, are instrumental in 
overcoming energy pits and process degeneration around, for example, local 
minimum. 

[0046] FIGURES 3D and 3E illustrate data stored in intermediate layers as the 
method progresses toward a possible mapping, the intermediate layers providing fiber 
resolution as each series of waves are propagated and convergence is achieved. 

[0047] FIGURE 4 shows the structure of a one-dimensional numerical 
transformation engine of one embodiment of the present invention, transformation 
engine 401 of FIGURE 4 may hold the value of (x,y) representing discrete sample 
points of a time dependent curve by storing "x" amplitude value in array at index 
value "y" representative of sampling time. As previously described, in Step 1 05 two 
waves are present a top-down wave and a bottom-up wave. In a preferred 
embodiment, the top-down wave and the bottom-up wave operate alternatively on the 
multi-level matrix to transform the data stored in the intermediate matrices toward a 
minimum energy convergence. For ease of explanation, the operation of the top- 
down wave and the bottom-up wave will be explained independently, and then an 
explanation will be given as to how these two waves work together to adjust the 
values of the cells contained within the inner layers of the multi-layer matrix. Also 
for ease of explanation, comparisons between the layers in FIGURE 4 will use terms 
such as layer above and layer below, referring to the positional orientation of the 
layers in FIGURE 4 as illustrated as horizontal rows of the matrix. For this 
explanation an adjacent layer below is defined to be, with respect to FIGURE 4, a 
layer which is positioned immediately below the current layer with no intermediate 
layer. Similarly, for this explanation, an adjacent layer above is defined to be, again 
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with respect to FIGURE 4, a layer which is positioned immediately above the current 
layer. Values within cells may also change during Step 105 from a present value to a 
future value. 

[0048] At the completion of Step 104 the present value of each cell is equal to 
the initial cell value as described previously, i.e., to the value stored in the closest top 
and bottom layer. Additionally, the determination of the future value of a cell is 
dependent on the position of the cell within the layer. For interior cells, those cells 
which are not positioned at the start or the end of the layer, the future value of the cell 
is dependent on a number of cells, e.g. , three other cells contained in nearly positions 
of the adjacent row according to a one dimensional transformation engine as 
described below. For end cells, those cells in the first or last position of a layer, the 
future value of the cell is dependent on one other cell in a one dimensional 
transformation engine as described below. Note that the dependency of a cell on three 
other cells represents one embodiment of the present invention and that other 
dependencies are within the scope of the present invention. 

[0049] For the bottom-up wave, the future value of an interior cell is 
determined by checking the present value in three closest cells in the adjacent layer 
above. In one embodiment of the present invention, when the multi-level matrix is 
operating in a comparative mode, the values of the top most row (the input layer) are 
not adjusted and continue to contain values representing the input pattern. Processing 
of the bottom-up wave therefore begins in the second layer. For each interior (i.e., 
non-end) cell in the second layer, the three closest cells in the first layer are examined 
to determine the cell in the first layer which has the value closest to the current value 
of the cell in the second layer. If "t" represents the cell index/location within a layer, 
and "s" represents the layer, Unit (s, t) may be used to represent the cell (or unit) in 
layer "s" in position "t". Using this convention, the reference for cell 402 in FIGURE 
4 would be Unit (2, 3). This convention is based on the layers being numbered from 1 
to 6 from top to bottom and the cells being numbered from 1 to 8 from left to right of 
FIGURE 4. In general, for the bottom-up wave, each unit (s, t) examines unit (s-1, t- 
1), unit (s-1, t) and unit (s-1, t+1). For each of these units, a unit containing a value of 
x and y which is closest to the present values of x and y in Euclidean distance is 
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identified. Note that the Euclidean distance between a vector V and a vector U is 
calculated as follows: 



[0050] In the bottom-up wave, once the value for each cell in a layer has been 
determined using the three cells in the adjacent layer above, the values for the cells of 
the adjacent layer below are calculated. In other words, for the bottom-up wave, once 
the values for the cells in layer 2 are determined using the values of the cells in layer 

1 , the value for the cells in layer 3 are determined using the values of the cells in layer 

2. This process continues until the values stored in the cells of layer 4, are used to 
update the values of the cells in the next to the bottom layer (layer 5 in FIGURE 4). 

[0051] The top-down wave operates similarly. For the top-down wave, the 
future value of the cell is determined by examining the three closest cells in the 
adjacent layer below. In one embodiment of the present invention when in 
comparison mode, the values of the lowest-most row (the memory layer) are not 
adjusted and continue to contain values representing the memory pattern. The top- 
down wave therefore begins in the second from the bottom layer (layer 5 of FIGURE 
4). For each cell in layer 5, the three closest cells in layer 6 (the layer immediately 
below layer 5) are analyzed to determine the value in the cell which has the value 
closest to the current value of the cell in the layer 5. In general, for the top-down 
wave, each unit (s, t) checks unit (s+1, t-1), unit (s+1, t) and unit (s+1, t+1). For each 
of these units, a determination is made as to which of the units contains a value of x 
and y which is closest to the present values of x and y in the same manner as 
previously described. In the top-down wave, once the value for each cell in a layer 
has been determined using the adjacent layer below, the values for the cells of the 
adjacent layer above are calculated. In other words, for the top-down wave, once the 
values for the cells in layer 5 are determined using the values of the cells in the 
memory layer (layer 6), the value for the cells in layer 4 are determined using the 
values of the cells in layer 5. This process continues until the values stored in the 
cells of the layer 3 are used to update the values of the cells in layer 2. 



between two points p and q = 
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[0052] As described, the bottom-up wave travels from the layer below the 
input layer (or the second layer in FIGURE 4) to the layer above the memory layer (or 
the fifth layer of FIGURE 4). Similarly, the top-down wave travels from the layer 
above the memory layer (the fifth layer of FIGURE 4) to the layer below the input 
layer (the second layer of FIGURE 4). As described, both the bottom-up and the top- 
down waves will pass through the middle layers of the multi-layer structure. In a 
preferred embodiment, the bottom-up and top-down waves are applied to middle 
layers alternatively. For example: 

A) A bottom-up wave is applied to layer 2. During this 
application of the bottom-up wave, values in layer 2 will be 
updated using values in layer 1 . 

B) After the bottom-up wave is applied to each cell in layer 

2, a top-down wave will be applied to layer 5. During this 
application of the top-down wave, values in layer 5 will be 
updated using values in layer 6. 

C) After the top-down wave is applied to each cell in layer 
5, the bottom-up wave is applied to layer 3. During this 
application of the bottom-up wave, values in layer 3 will be 
updated using values in layer 2. 

D) After the bottom-up wave is applied to each cell in layer 

3, the top-down wave will be applied to layer 4. During this 
application of the top-down wave, values in layer 4 will be 
updated using values in layer 5. 

E) After the top-down wave is applied to each cell in layer 

4, the bottom-up wave will be applied to layer 4. During this 
application of the bottom-up wave, values in layer 4 will be 
update using values in layer 3. 

F) After the bottom-up wave is applied to each cell in layer 

4, the top-down wave will be applied to layer 3. During this 
application of the top-down wave, values in layer 3 will be 
update using values in layer 4. 

G) After the top-down wave is applied to each cell in layer 
3, the bottom-up wave will be applied to layer 5. During this 
application of the bottom-up wave, values in layer 5 will be 
updated using values in layer 4. 

H) After the bottom-up wave is applied to each cell in layer 

5, the top-down wave will be applied to layer 2. During this 



25396858.3 



20 



Attorney Docket No. 697.004 CIP 



PATENT 



application of the top-down wave, values in layer 2 will be 
update using values in layer 3. 

[0053] This alternating process completes one application of the bottom-up 
and top-down waves in the 6 row matrix of the present example. Note that bottom-up 
and the top-down waves must reach the middle layers in intermittent order. If there 
are n=2m layers then in one cycle the bottom-up wave reaches layer m first and only 
then does the top-down wave reach the m-1 layer. In the following cycle the top- 
down wave reaches the m-1 layer first and only then does the bottom-up wave reach 
the m layer. 

[0054] As described, each interior cell or unit is compared to three other cells 
or units in either a layer above (for the bottom-up wave) or a layer below (for the top- 
down wave). Thus, the cell is compared to the t-1, t and t+1 cells in the 
corresponding layer. For end cells either the t-1 or the t+1 cell is unavailable. For the 
t = 1 cells, the t-1 cell in the layer above or below is unavailable and for the t = 
maximum (t = 8 in FIGURE 4) the t+1 cell in the layer above or below is unavailable. 
In these circumstances, a different method of updating the value of the end cell is 
required. In these instances the Far Differentials - Far Span K Distance — span 
connections cannot be used either. For the end cells, Unit (s, 1) or Unit (s, m) in the 
bottom-up wave the cell value is set equal to the value of Unit (s +1, 1) or (s+1, m) 
respectively. For the end cells, Unit (s, 1) or Unit (s, m) in the top-down wave the cell 
value is set equal to the value of Unit (s -1, 1) or (s-1, m) respectively. 

[0055] Note that using simple Euclidean distance for updating Unit (s, t) 
cannot guarantee convergence to a global minima of the sum of square distances. A 
more efficient method of achieving the global minimum is by use of a Far Differential 
- Far Span K Distance Connection. The Far Differential - Far Span K Distance 
Connection describes the metrics necessary to achieve a global minimum. This 
procedure minimizes a more complex energy or distance function in order to 
implement complex visual comparison tasks. The Far Differential - Far Span K 
Distance Connection between Unit (s, t) and Unit (s, t+k) is Unit (s, t+k)-Unit (s, t). 
Similarly, the Far Differential — Far Span K Distance Connection between Unit (s, t- 
k) and Unit (s, t) is Unit (s, t-k)-Unit (s, t). 
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[0056] FIGURE 3D shows the one dimensional, time dependent curves which 
represent the layers within the matrix during the early stages of the application of the 
top-down and bottom-up waves. Similarly, FIGURE 3E shows the one dimensional, 
time dependent curves which represent an advanced stage of the application of the 
top-down and bottom-up waves. 

[0057] There is a gradual reduction in the intensity of the changes in the 
values stored in the cells during the application of the top-down and bottom-up waves 
and an ebbing resonance stage is reached. Ebbing Resonance is a relaxation process. 
The word "relaxation" as used herein has the same meaning as in non-linear 
optimization theory. Here, relaxation is accomplished by gradually reducing the Far 
Span K Distance Connections. While this reduction alone is insufficient to guarantee 
convergence, it provides additional stability to the procedure. In order to guarantee 
convergence using a full numeric solution, a power of logarithmic Radial Basic Decay 
function is used in a Hierarchical Zooming convolution and is applied to the 
input/STM layer and the memory/LTM layer simultaneously. In addition, the 
Convolution scale is also gradually reduced. 

[0058] The Far Span K Distance Connections modifies the Euclidean distance 
that is used by the top-down and bottom-up waves. For example, application for Far 
Span K Distance Connections causes the Euclidean distance \U(s 9 i) — U(s 9 i + 1)| to 
become Distance(U(s,i+l)) = |U(sJ)- U(s+l,i+l) + a*(U(s,i+k)- U(s,i)- U(s+1, i+l+k)+ 
U(s+1, i+lF a*|U(s, i-k)- U(s,i)- U(s+1, i+l-k)+ U(s+1, i+l). During the ebbing 
resonance, the real number "a" is also gradually reduced with "k" and with the radius 
of the Hierarchical Zooming convolution. If a convolution tool is not available and 
the values in the cells or units are kept constant during the Ebbing Resonance, 
convergence may still be obtained by the use of a very high Resonance rate (0.995 
for 128 layers) and gradually reducing the resonance rate, the "k" parameter and the 
"a" parameter. This procedure allows the resonance rate to be gradually reduced 
during Hierarchical Zooming. 

[0059] Once the Ebbing Resonance process has been completed, update waves 
may be used to carry information between the layers of the matrix. For example, an 
update wave may be used to propagate index related information from the input layer, 
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through each of the intermediate layers to the memory layer to create a point-to-point 
mapping between cells in the input layer and cells in the memory layer. Top-down 
and bottom-up update waves may be applied to the matrix to determine point-to-point 
mappings. In a one-dimensional transformation engine, each unit or cell checks three 
units in an adjacent layer (the layer above for bottom-up and the layer below for the 
top-down). One of the three units in the adjacent layer holds a value of x, y which is 
closest to the values of x, y of the current unit in Euclidean distance. An intrinsic 
index, which represents the unit in the adjacent cell which had the closest value, is 
then stored in the current unit. This process is repeated for each cell in the layer, and 
for each layer in the matrix. After each cell of each layer has been examined and an 
intrinsic index has been stored, the intrinsic index propagates from the input layer to 
the memory layer and vice versa. 

[0060] The final mapping is influenced by the number of layers contained in 
the matrix and the pattern degeneracy. Here a degenerated pattern is a function f that 
is defined on a domain D f such that there exists an open set Q such that the Gaussian 
curvature K of the manifold D f f on Q is 0. 

[0061] FIGURE 5 shows a mapping between a stored signature 501 and input 
signature 502 with corresponding points connected by line segments. The bottom 
signatures include intermediate layer information. Note that reflex points are 
maintained without a requirement for their independent identification. 

[0062] FIGURE 6 represents another embodiment of the present invention 
which may be used to perform selective attention so as to identify a predetermined 
object in amongst other objects and/or a noisy environment. In an image context, as 
previously described, selective attention includes the ability to isolate a visual object 
from a background or other objects. In the comparative mode of the present invention 
described previously, the values stored in the cells of the input layer and the values 
stored in the cells of the memory layer are held constant. To perform selective 
attention the cells which represent the background portion of the image or pattern 
stored in the memory layer are allowed to converge to any value as required. 
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[0063] In performing Selective Attention the background pixels of an image 
that are stored in the LTM memory layer are "turned loose." They can converge to 
any value. This requires that the Convolution that is used in the Hierarchical 
Zooming process that is part of the Ebbing Resonance must be redefined. 

[0064] Referring to FIGURE 6, if the two input/STM and memory/LTM 
patterns are a two dimensional encoding of the edges of an image. An image can be 
encoded on a pixel board using a physical phenomena such as electric fields. If two 
additional layers are added, one prior to the input layer and one after the memory 
layer, then the distance between the pre-input layer and the input/STM layer serves 
for "blurring the image." A relaxation can be achieved by gradually decreasing the 
distance between the pre-input and the input layer. The same is done with the 
memory layer. The distance between the memory layer and the post-memory layer is 
gradually decreased, the result is that both the input and the memory patterns 
gradually become clearer. Now the pre-input and post memory/LTM layers are held 
constant instead of the original input/STM and memory/LTM layers. The desired 
behavior of the system can be mathematically shown, the electric field potential 
depending on 1/R where R is the distance from the electric charge. Thus, as the 
distance r between the memory/LTM and the post memory/LTM board grows, the 
potential difference between two points on the post memory/LTM board as seen on 
the memory/LTM board as, 

Potential difference = , gl - , ^ 2 such that q x and q 2 are the 
charges 

of pixel, and pixel 2 respectively and d ] and d 2 are the "horizontal" distance from 
the interacting point on the memory/LTM board. As r increases, the influence of d ] 
and d 2 is reduced and the image on the memory board becomes blurred. The loose 
cells in this case are on the post memory layer. 

[0065] Note that while the examples used to explain the invention used a 
matrix containing 6 layers with each layer including eight cells or units, the present 
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invention may include a matrix with any number of layers with each layer containing 
any number of cells. As the number of layers increases the granularity of the process 
is reduced such that difference in values stored from one cell to an adjacent cell is 
minimized. 

[0066] Note also that while the examples used to describe the present 
invention were limited to a one-dimensional numeric transformation engine, other 
embodiments exist, including multi-dimensional matrices and data spaces that are 
within the present invention. 

[0067] The embodiments of the present invention described thus far 
incorporate a digital means to produce the metamorphosis of the patterns from the 
LTM pattern to the STM pattern. Instead of using digital numeric calculations 
another embodiment of the present invention uses electric fields to accomplish the 
time varying convolutions and the vibration waves used to complete the gradual 
metamorphosis. In this physical embodiment, the units that constitute the layers 
between the input/STM layer and the memory/LTM layer may be either passive (for 
example induced or constant dipoles) or active (for example CMOS components). In 
either case, the units that constitute the intermediate layers cannot be fixed in space. 
If passive units constitute the intermediate layers, these passive units cannot be 
spherical in shape, but must provide some form of asymmetry with respect to a 
desired physical characteristic, e.g., electric change (dipole), magnetic orientation 
(North/South),' etc. One requirement of the passive units is that they be able to point 
in any direction, i.e., free to orient in a position under influence of a field. 

[0068] The resonance and the update waves, the "reduction of the intensity of 
the waves" (The Simulated Annealing) and the Far Span k-Distance connections (Far 
Differentials) described thus far employ a numeric, digitally implemented means of 
achieving a gradual metamorphosis between the input STM pattern and the memory 
LTM pattern such that in every intermediate pattern the Topology (Shape) is 
preserved. That is, manipulation of data patters products a numeric representation of 
the metamorphasic. 
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[0069] In the digital means of achieving a transformation engine and other 
strongly cooperative systems, local coupling of degrees of freedom lead to scaling 
phenomena through a cascade effect which propagates throughout the entire system. 
The transformation engine approach generates new potentials (known as 
Hamiltonians) from older potentials by incrementally removing degrees of freedom 
during each iteration. At the completion of each iteration a Hamiltonian representing 
unchanged length scale interaction remains. 

[0070] The present invention also includes a physical transformation engine 
which includes mixed terms in corresponding Hamiltonian. In this case, it is 
unnecessary to progressively integrate-out degrees of freedom by the use of Ebbing 
Resonance and For Spin K-distance connection. 

[0071] FIGURE 7 shows a dimensional hexagonal implementation of a 
transformation engine according to an embodiment of the invention. A cell or unit in 
a two dimensional numeric transformation engine can be generally represented by 
Unit (s, t, w) where "s" represents the layer and "t, w" represent the coordinates of the 
unit within the layer. In the two-dimensional transformation engine unit (s, t, w) now 
interacts with seven units in layer s+1 and seven unit in layer s-1. Unit (s, t, w) 
"examines" (i.e., the following nearby units are examined in formulating an updated 
value to store into unit (s,t,w)) unit (s+1, t+1, w+1), unit (s+1, t+1, w-1), unit (s+1, t- 
1, w+1), unit (s+1, t-1, w-1), unit (s+1, t, w+2), unit (s+1, t, w-2) and unit (s+1, t, w). 
Unit (s, t, w) also interacts with seven units in layer s-1 namely: unit (s-1, t+1, w+1), 
unit (s-1, t+1, w-1), unit (s-1, t-1, w+1), unit (s-1, t-1, w-1), unit (s-1, t, w+2), unit (s- 
1, t, w-2) and unit (s-1, t, w). 

[0072] The transformation engine may be described by using the idea of 
Minimization of an Action Integral and Calculus of Variations in order to describe a 
potential p (scalar function p(x, y, z, t)) that preserves the geometric properties of 
itself as it changes from the input STM pattern to the memory LTM pattern. Note that 
a single potential is insufficient in order to generate realworld metamorphosis 
between patterns. Also note that a physical transformation engine should work on 
two-dimensional patterns of Grey Scale patterns. 
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[0073] The minimization of an Action Integral may be used to derive 
Einstein's Gravity equations and the Quantum Mechanics equations. As further 
described below, the transformation engine may be described in terms of an Action 
Integral. Additionally, the Action Integral of the transformation engine may be 
written in Tensor form and may have applications in String Theory. 

[0074] Both Far Span k-Distance Connections and the Ebbing Resonance 
process are redundant in a physical implementation of a transformation engine 
consistent with the invention. A hardware transformation engine is capable of 
performance beyond the Turing limit, meaning that a pure software solution will not 
be able to perform as well as the transformation engine. Instead, a physical hardware 
based transformation engine demonstrates a behavior that is dictated by a local 
Hamiltonian. For this reason the Far Span k-distance connections are rendered 
redundant. Far and near geometric features are encoded by Spatial Frequency 
functions. As will be shown the principles of Dielectrophoresis and of Electrorotation 
are an outcome of the Hamiltonian that is minimized by the transformation engine. 

[0075] An Action Integral is an integral over space and time of an operator 
over a function. The operator in the integral is a Lagrangian. If the integral is a sum 
of a potential and the kinetic energy then the Lagrangian is an Hamiltonian. 

[0076] Considering the classical physics action of a charged particle in an 
electric field of another charge that is fixed. The Hamiltonian (L) for speed (v) mass 
(m) and positive (ql) and negative (q2) charges, and one free particle coordinates x(t), 
y(t), z(t) such that time (t) is given as: 





then the action's variation vanishes 



t xyz 



0=5 \\\\Ldxdydzdt 



t xyz 
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[0077] Note that the Hamiltonian of the transformation engine will have a 
hardware implementation using units that behave like induced electric dipoles in the 
sense that they depend on the gradient of the local electric field E. 

[0078] The Hamiltonian is an operator that is defined over the location vector 
function (x(t),y(t),z(t)). Minimizing the Action Integral results in motion equations of 
the particle that are not fixed. In the calculus of variations the minimization of an 
action integral simply means that the variation of the action Hamiltonian is either 0 or 
vanishes. 

[0079] The transformation engine provides: 1) intermediate patterns 
representing a metamorphosis between and affected by both input STM pattern and 
memory LTM pattern, and 2) intermediate patterns that change between the STM and 
LTM layers such that their respective geometric characteristics are not lost. 

[0080] FIGURE 8 is an illustration of either an input STM or LTM including 
pixels of metal 801, where each pixel of metal 801 is fed with a different alternating 
or constant voltage at different frequencies. This physical implementation of a 
transformation engine model provides a solution in which pixels of the same 
layer/board will not interact with each other in a way that will disrupt the generation 
of the plurality of metamorphosis patterns between the input STM pattern and 
memory LTM pattern. From the metamorphic between the LTM and STM patterns 
and the preservation of geometric characteristics, the transformation engine 
Hamiltonian is the sum of at least two terms. One term forces the intermediate values 
of the potential field, that represents a changing pattern, to change between the STM 
and the LTM patterns and the second term is responsible that geometric information 
will not be lost in between. A tensor form transformation engine Hamiltonian will 
also be presented causing a minimization of energy and minimization of the loss of 
geometric information. Note that, in the physical transformation engine, the action 
integral need not depend on time although a "full" physical solution must depend on 
time. 

[0081] In a two dimensional transformation engine a gradual metamorphosis 
is generated between the input STM pattern and a memory LTM pattern. If the 



25396858.3 



28 



Attorney Docket No. 697.004 CIP 



PATENT 



pattern is encoded by potentials (or some other scalar function) then each pixel in the 
STM and LTM boards will hold a different potential. For the intermediate potential 
between the two boards to gradually change it is sufficient to require that the integral 
of the square of the gradient of the potential to be minimized. In electric field terms, 
that fits the minimization of the integral on the squared electric field. Multiplying this 
value by the half of the permitivity factor yields the static electric field energy, 

E„er gy =fJfJ«f)> + <|>M$)'*.^ 
[0082] The incomplete Hamiltonian of a transformation engine may be written 

as: 

L = ((^r) 2 + (^) 2 + (ct) 2 + Unknown term = Vp • Vp + Unknown term 

ax ay dz 

0 = 5 JJj£ (L + Unknown terrri)dx -dy-dz 

[0083] 0 in the expression above means that the variation of the integral 
vanishes. This Hamiltonian is equivalent to the square distance between units 
previously described with respect to reaching the ebbing resonance stage and using 
the for span k-distance connection to amend the Euclidean distance. In a 
transformation engine that explicitly uses plurality of layers, information is not lost as 
a pattern changes from one intermediate layer to an adjacent intermediate layer. As 
previously described, the Far Span k-Distance Connections is responsible for the 
conservation of geometry. 

[0084] Writing this term locally means that the difference of a potential pi 
and p2 on layer S will not change excessively in view of the counterparts ql, q2 in 
layer S+l or S-l. Thus, ((p2-pi)-(q2-qi)) 2 must be added to the Hamiltonian, wherein 
the direction pi to ql is the direction of the derivative of the potential. 

[0085] The difference between two adjacent intermediate potential layers is 
also held constant. Referring to FIGURE 9, if the Z axis is the direction in which the 
potential changes and the adjacent potentials along the Z axis are pi (901) in layer S, 
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ql (902) in layer S+l and wl 903 in layer S+2 then it is desirable to minimize ((pl- 
ql)-(ql-wl)) 2 . In general an objective is to minimize ((p2-pi)-(q2-qi)) 2 + ((pl-ql)- 
(ql-wl)) 2 along the transformation direction. For ease of explanation, Z will be as the 
local direction of the gradient P. The sum of the last two terms as differentials is then 
equal to 

((p2 - pi) - (q2 - ql)) 2 + ((pi - ql) - (ql - wl)) 2 



(dZ) 2 



[0086] In order to write the last term such that the potential p may change in 
any direction, the general form is (VVP • VP) • (VVP • VP) . 

[0087] In second derivative terms this term can be written as, 



Term 2 in the lagrangian is the scalar 
(VVP • VP) • (VVP • VP) 



VP = 







U 2 P 


a 2 p 


d 2 p | 


dx 




d xd x 


d xdy 


d xdz 


d p 


VVP = 


<? 2 p 


a 2 p 


S 2 P 


dy 




dydx 


dydy 


dydz 


d p 






<? 2 p 


e 2 p 


\dz) 




^dzd x 


dzdy 


d zd y 



The second derivative matrix is multiplied by a vector so 
(VVP* VP) = 



^ 2 p 



S 2 P 



d xd x d xd y d xd z 



S 2 P 



S 2 P 



a 2 p 



S 2 p 



S 2 P 



d zd x d zd y 



d yd x d yd y d yd z 

3 2 P 
dzd y 

d 2 p d p i d 2 p d p 
d xd x dx 
d 2 p d p 
d yd x d x 
d 2 p d p 



'd_p} 

dx 
d_p 

dy 

£ P 

dz) 



+ 



— + 

d xdy dy 


d xdz dz 


d 2 pd p ( 


d 2 p d p 


dydy dy 


dydz dz 


d 2 P d p ( 


d 2 p d p 



dzd x d x dzdy dy d zd y d z 



25396858.3 



30 



Attorney Docket No. 697.004 CIP 



PATENT 



[0088] Adding the energy Hamiltonian to the Hamiltonian that preserves the 
geometry in local terms yields: 

Hamiltonian = VP • VP + K(VVP • VP) • ( V VP • VP) + 
Optional additional terms where K is some constant. 

[0089] The optional terms may involve higher derivatives of the potential P. 
This function is the Hamiltonian of a transformation engine according to the present 
invention; the plurality of metamorphosis patterns between two boundary conditions 
which are the input STM pattern and the memory LTM pattern as described. 

[0090] Note that a second derivative of the potential is multiplied by the first 
derivative resulting a product in the form of a vector. Such a term is consistent with 
elongated induced dipoles in a local electric field. This is because electric dipoles 
respond to or "feel" force when they are positioned in an electric field such that the 
second derivative does not vanish. Elongated dipoles that are made of conductive 
material align with the first derivative of the potential and therefore the Hamiltonian 
that is the result of the previous illustration implicitly dictates the use of elongated 
dipoles. In order to be totally consistent with the Hamiltonian the dipoles should be 
ideal needles at sufficiently high resolution and with no or minimal resistance. 

[0091] Dielectrophoresis itself is insufficient to explore the description of 
elongated induced dipoles. The net force on an isotropic elongated dipole in an 
electric field depends on the fields alternating and constant components e.g., 
V = Vfr ase + A * cos(cof ) such that co is the frequency of the alternating component, A 

is the amplitude in voltage and V baS e is the voltage baseline. The force on a spherical 
dipole may be expressed as: 

F Dipole = 27cR l s m Re[*(co)]V£ 2 

[0092] Such that K is the Clausius Mossotti constant. This refers to the 
relationship: 
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/c(<y) = _p — such that e =s-- — and a is the conductivity of the 

e p +2s m co 

particle 

[0093] wherein c m' and 'p' stand for medium and particle (respectively) and j 
is the square root of -1. Note that the third power of R makes it difficult to exert 
strong forces using spherical particles especially when R is very small. Further, the 
conductivity is extremely important in order to achieve highly responsive particles. A 
more complex model is of particles on which the electric force depends on the 
frequency co. A highly conductive needle shaped particle redirects the electric field 

because the potential depends on the orientation of the needle. The term 2nR can be 
ignored for needles. Thus, the needle will be parallel to the field. We know from the 
simple case of constant dipoles that the minimum energy of a dipole D in a field E is u 
= -D*E where D is the dipole. 

[0094] The transformation engine Hamiltonian and the square force on a local 
dipole are linearly dependent, (-^-(VE 2 )) 2 = (E • VE) • (E • VE) oc F Dipole 2 . 

[0095] Note that minimizing the geometric part of the transformation engine 
Hamiltonian means that the integral of the square force on all the dipoles is 
minimized. This result may not be readily apparent in light of the energy of a spring 

1 2 1 2 2 1 2 

is —KX = IK X ) = F where K is the spring constant. 

2 2K V ' 2K 

[0096] The variation of the transformation engine Hamiltonian must vanish 
between the input STM pattern (first boundary condition) and the memory LTM 
pattern (second boundary condition), so: 

0 = 8 JJJ( VP • VP + K( VVP • VP) • ( VVP • VP))dx dy dz 

x,y,z 

[0097] If the number of layers in the transformation engine is sufficiently 
large and the distance between the STM and LTM is also sufficiently large and fields 
are relatively strong then the constant K can be very large. In practice the 
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transformation engine can work with very high terms of K of about 4096 and if the 
gradient of p is calculated over far points within the same layer then K can even be 
10 5 or larger. The larger the K constant is, the closer the transformation engine is to a 
complex springs machine. Note that for practical applications of the transformation 
engine one potential is insufficient. 

[0098] The theory about spherical isotropic particles that are placed in an 
electric field is insufficient when the shape of the particle is not spherical. The 
Hamiltonian of the transformation engine requires ideal needle shaped particles. The 
dependence of the net force on a dipole depends of the gradient of the electric field 
and that feature is applicable also in non-spherical dipoles. 

[0099] Instead of using a single potential, p, several potentials should be used 
in order to resolve two dimensional ambiguities. That is, e.g., different alternating 
voltage frequencies and elongated pieces of 

material/particles/proteins/neurotransmitters that reside between the LTM and STM 
pixel boards can serve as vector fields because an elongated particle points to a 
direction and behaves like a needle that is placed in electric field and turns until it 
reaches equilibrium in minimum energy. If such "needles" respond to different 
frequencies and each "needle" is wrapped in an isolating ball, then the needles align 
like vectors in local fields. Since needle characteristics may be selected so that the 
needles selectively respond to different frequencies, the system of two pixel boards, 
STM and LTM and dipoles that respond to different voltage frequencies - "different 
needles" - simulate a multi potential system. 

[0100] The Hamiltonian of multiple potentials P(i) may be expressed as: 

ZSvp(/).vP(y) + K(vvp(/).vP(y)).(vvp(/).vP(y)) 

/=1 y=i 

such that the variation over the n potentials vanishes, as follows: 
n n 

0=8 JJJ £ ^(VP(i)»VPU) + K(VVP(i)*VPU))»(WP(i)»VPU)))dx dy dz 
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in a gray scale image. This mathematical formulation is consistent with at least one 
preferred embodiment of a transformation engine according to the invention. 

[0101] The mixed term of: 

Z Z ( vp ( ; ) # vp 0* ) + *( WP(/ ) • VP(y )) • ( VVP(/) • VP(y ))) 

is made of two parts, namely: 

[0102] The part of the Hamiltonian that forces the pattern to gradually change 
from the input STM to the memory LTM pattern may be expressed as: 

ZZ vp ('>vp(/) 

/=iy=i 

[0103] Minimization of this term alone means an electric like field lines 
between the input STM pattern and the memory LTM pattern: 

a) The part of the Hamiltonian that forces the pattern to maintain its 
geometric properties as it gradually changes from the input STM 
pattern to the memory LTM pattern is 
n n 

K * £ Z vvp ( / ) # vp 0')) # VVP(/) • VP(y ) such that K is some 
/=1y=1 

constant. 

[0104] A gray scale image can be decomposed into high and low frequency 
Fourier Transforms. A single picture can be translated into multiple pictures using 
either Fourier Transforms or Wavelet Transforms. In an input STM pattern there are 
wide vertical stripes and an LTM pattern where the stripes are narrow, the Fourier 
Transform frequencies that will maximize on the STM pattern will be lower than the 
Fourier Transform frequencies that will maximize on the input STM pattern. The 
Hamiltonian that is minimized therefore must include mixed terms if the potentials 
P(i) need to represent different frequencies Fourier Transforms. 
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[0105] A Hamiltonian that is made of different potentials reduces the degrees 
of freedom of the transformation between the input STM pattern and the memory 
LTM pattern. 

[0106] A potential is a function from R n to R. The explicit second order 
(second derivatives) Hamiltonian is: 

E Z (VP(/) • VP(j ) + K( VVP(#) • VP(/)) • ( VVP(/ ) • VP(y ))) 

/=1 y=i 

such that P(i) are the potentials. 

[0107] Renormalization group methods and introduced to provide a method of 
treating systems in which multiple degrees of freedom spanning many scales of length 
are locally coupled. At the end of each step a Hamiltonian results that represent the 
interactions over length scales not yet treated. In particular, changes in gray-scale 
levels occur over many scales of length for which the image is organized. Thus, the 
transformation engine integrates many prior data that comes from lower level neurons 
such as VI, V2, LGN and integrates all this data into single high-level Neurons. 

[0108] Coupling, is in terms of the Hamiltonian because the different scales of 
features in one image may fit different scales of features in another. For example 
wide lines in the input image may be fit to narrow lines in the memory image. The 
fitting problem may be even more complex. As shown in FIGURE 10, it may be 
desirable to map a disk that is full of + signs 1001 to a disk full of - signs 1002 or to 
map such rectangles without coupling. Coupling is a mathematical term that is a part 
of the Hamiltonian of a system such that it includes multiplication of functions with 
different indices. (E.g., fi(x,y)*f 2 (x,y)+fi(x,y)*f3(x,y)-i-f2(x,y)*f3(x,y) that is a sum of 
three coupled terms fi(x,y)*f 2 (x,y), fi(x,y)*f 3 (x,y) and f 2 (x,y)*f 3 (x,y) such that x,y are 
planar coordinates.) 

[0109] Coupling may involve dipoles that are subject to maximum torque 
force when exposed to two different frequencies of alternating voltage. Thus the 
mixed terms in the transformation engine Hamiltonian can be implemented using, for 
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example, Evotec OAI technology. A parceling of two particles that each responds to 
different frequency provides an exact solution to the coupling problem. 

[0110] Two boundary conditions of the LTM and STM are well defined. 
Those are the LTM board and the STM board. The potential LTM = P(X,Y,0) and 
STM = P(X,Y,1) denote the LTM and STM patterns respectively. The convergence 
of the mapping between the LTM and the STM such that the topology is preserved 
depends on the distance between the LTM and the STM. Based on this constraint, the 
gradient of the potential should be as perpendicular as possible to the LTM and STM 
boards. 

[0111] Referring to FIGURE 11, the "+" sign 1101 is encode by a 5000Hz 
alternating voltage that is fed to part of pixels in memory pattern and 1000Hz encode 
the sign 1102 on the input pattern. Units that respond to both 5000Hz and to 
1000Hz generate the map between the input pattern and the memory pattern. 

[0112] The transformation engine Hamiltonian of a single potential is 
consistent with the laws defined by General Relativity. It is probable that the 
description of matter in the cosmos as a transformation engine requires more than one 
potential. However, for the purposes of the present illustration, one potential is used 
herein and developed into tensor form for simplicity of explanation. The 
transformation engine can take an interesting General Relativistic form with the 
following geometric implications. To express the transformation engine in terms of 
covariance principle articulated by Einstein, it is sufficient to replace the x,y,z 
parameterization with x,y,x,ct such that c is the speed of light and t is the time, and to 
replace each derivative with a Covariant or with a Contravariant derivative. 
Einstein's summation conventions will be used (upper and lower indices are summed 
up). 

[0113] Writing L in Einstein's tensor convention provides: 

L = (p i P i + Kp n p k ;nP m P k ;m)V-g 

such that p is the pattern potential that gradually changes between the STM and the 
LTM patterns. 



25396858.3 



36 



Attorney Docket No. 697.004 CEP 



PATENT 



[0114] In the present case, LTM can be a known distribution of the potential 
field p in the past t=0 and the STM can be a current distribution for t=l such that a 
description of the cosmos may be expressed in terms of what happens in-between. In 
such a case the Hamiltonian L can have terms higher orders for example: 

L = (p j Pi + Kp n p k ;n p Vim + K 4/3 p n p k ; L ; n p V; L ; m )V-g 

where -g is the minus sign of the determinant of the metric tensor, the square root of - 
g is the scaling factor of a volume element, where K is a constant and the semi colon; 
denotes the covariant derivative. The power 4/3 is provided to account for 
dimensionality. The Hamiltonian can be written in another form 

L = (p'ps + p n Ata p m A k m + p n B kLn p m B kL m ) V-g 

where A and B are high-order tensors 

if pV; m = 0 then P m is geodetic. 

[0115] In terms of differential geometry p m p k ; m is an evaluation of how 
parallel the field p m changes in relation to itself. If this term is 0 then p m is a geodetic 
field and it represents an inertial particle. If this term is not 0 then it means that a 
"force" acts on matter. For this reason the transformation engine can be one of the 
models a unified force theory of the fine fundamental forces. 

[0116] Using the Christoffel symbols {kn,u}, comma for derivative and gjj as 
the metric tensor, results in the relationship: 

L=(P, m P, k g mk + K g^jg* (P, k ,n-{kn,u}P, u ) (P,^ 11 (P, L ,n-{Ln,u}P, u ).)V-g 

the square root of the -g term is always used in General Relativity for the 
measurement of a 4-volume element on the space-time manifold. 

[01 17] The Cristoffel symbols written explicitly provides: 

M=\g xu ^ kVn +g nVk - gkn , x ) 

[0118] The variation over the space-time manifold should vanish, that is, 
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0 = 5 HP, m P. k 9 mk + K 9 Lk (P. j 9 jn (P* . n -{^P.u ) (P»j 9 j ° <P. L -n -{ L n} P ' u ^ 
such that Cl is the 4-volume space-time domain. 

[0119] Transformation engines according to another embodiment of the 
present invention may also be constructed using FM and microwave frequency 
electric diploes. As described, the transformation engine uses units that align and 
generate a plurality of intermediate patterns between the input STM pixels board and 
the LTM memory board. One method of accomplishing this is by using a spring or a 
coiled shaped polymer that is coated with metal. The two tips of the spring are ball 
shaped and the entire spring is embedded in a spherical polymer as appears in 
FIGURE 12. 

[0120] Each unit in FIGURE 12 includes a sphere 1201. Within sphere 1201 
there is a liquid with a dielectric constant (Ke) 1202 as close to 1 as is possible with 
some types of oils. The core 1203 of sphere 1201 is free to turn sphere 1201 (such as 
a baseball shaped polymer). Core 1203 may, for example, contain coil 1204 with two 
ball shaped tips 1205 and 1206 attached. For proper functioning of the transformation 
engine the units must be free to be aligned within a field. For example, the dipole 
may be baseball shaped, spring shaped or in the shape of a needle. Spherical diploes 
do not redirect the external field and can only perform conformal maps because of 
Laplace' equation. Conformal maps map tangent curves to tangent curves and thus 
spherical dipoles (that effectively change the permitivity of space) should generally 
not be employed by the transformation engine. 

[0121] The approximated maximum force that will be felt by the unit depends 
on 1/LC where that L is the coil's magnetic induction constant in units of Henries and 
C is the capacitance of the dipole. A formulation of the optimum frequency of an 
external electric field also depends on other factors such as resistance. 

[0122] A single unit can contain two different parallel coils and can thus 
respond to two independent frequencies. This property is useful in order to obtain 
appropriate coupling. Coupling in the transformation engine sense is broader than in 
Ising spin models because real induced dipoles can point to any direction and the 
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coupling relates to frequencies and not of quantum spins. The coil or spring shaped 
dipole or two dipoles in each unit cause the unit to turn, or align, in response to local 
fields at different frequencies (e.g., 10000 KHz and 57000 KHz) and other whole 
multiplicity of these two basic frequencies (e.g., n* 10000 KHz and m* 5 7000 KHz) 
wherein m and n are whole numbers greater than or equal to 1. 

[0123] These units can be placed on many boards, or inner layers, between 
the input pixels board (containing the STM and LTM patterns) and they can be 
suspended in liquid between the input and the memory boards. 

[0124] As shown by FIGURE 13, the inner layers, in solid systems, may be 
considered boards 1301 of spherical cells in which these units 1302 are suspended. 
The number of possible solid configurations is limited by the corresponding physics. 

[0125] As shown in FIGURE 14, one example solution is to mix many 
different units of 40nm of size between the input and memory boards. These units are 
then suspended in water or other suitable liquid or, more generally, fluid and respond 
to the electrodes that are connected to the middle of each Input and memory pixel. 
This configuration may be viewed as a "liquid transformation engine". 

[0126] Camera 1401 is used to convert an image into electrical signals on 
pixel board 1402. Edge detectors check groups of adjacent pixels for horizontal, 
vertical and diagonal lines. Identified edges are contained in pixel board 1403. This 
may be accomplished by the edge detector which identifies the edge firing at a certain 
frequency into pixel board 1403. Additional and more complexed detection may also 
be performed on the pixel boards. For example, a object recognition software may be 
used to identify various objects such as a human heel, an ear, a nose, or other 
predefined objects. Detection units which objects within portions of the pixel image 
may also fire at specific frequencies into corresponding pixels of pixel board 1404. 
Both pixels boards 1403 and 1404 are connected to transformation engine 1405. 
Specific pixels in the transformation engine's input pixel board receives pulses both 
for the existence of an edge and for the existence of identified objects. Electric 
dipoles 1406 within the transformation engine align such that the energy between the 
input board 1407 and the memory board 1408 is minimized. Within the 
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transformation engine the suspended units maneuver or are otherwise positioned 
and/or oriented to accomplish this alignment within the surrounding material, such as 
the liquid. Individual units may respond to different frequencies and create a mapping 
between dissimilar objects such as an input of "x's" to a memory of "o's". The 
memory board is connected to a regeneration oscillator chip. The chip is able to 
"learn" (i.e., characterize) the pulses coming from the input board and later to 
regenerate these pulses. Object recognition unit 1409 analyzes the signals received 
from the input board. If these signals match the learned and stored signals then the 
transformation engine fires in order to indicate or signal a match between the image 
and the stored information. 

[0127] Note that a solid solution may be less efficient than a liquid or gaseous 
solution. In the solid machine the spherical units also have a core that is an elongated 
dipole, possibly spring shaped, that is free to turn in space. The units should have a 
limited angular freedom of movement. The spheres denote the cells that contain 
spring shaped elongated dipoles. 

[0128] FIGURES 15 A and B illustrate a solid structure which may be used as 
a transformation engine. In this embodiment the dipolar units in a dipolar 
transformatron can be ordered in a cyclic structure of three planar layers. In each such 
layer the elongated dipoles are positioned in the vertices of 60°, 60°, 60° triangles. 
Each layer is shifted downward by 1/V~3 in relation to its previous layer. Due to 
differences in the number of units along diagonal paths and perpendicular paths from 
the input to the memory layer, and vice versa, the space between the layers (the 
interlayer substance) is filled with non homogenous material; otherwise the layer's 
structure is totally homogenous. 

[0129] FIGURE 15 A illustrates layers S, S+l, S+2 on top of each other while 
FIGURE 15 B illustrates top layer S 1501. Referring to FIGURE 15A, layers S 
(1501) , S+l (1502), S+2 (1503) show a cyclic structure of three layers. The structure 
of each layer is just 60°, 60°, 60° isosceles triangles that optimally cover or tile the 
plane. The layers are identical in structure. Each two adjacent layers are shifted by a 
distance of lA/~3 units of length. Each of the triangle sides is 1 unit long. The 
geometric intersection of the medians and the heights of each triangle in layer S is the 
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same. The distance of each vertex from the heights intersection is 

y r ^ 

^ = cos(30°) = — o y = -\= as in FIGURE 16. 
y 2 V3 

[0130] FIGURE 16 shows the orientation of the layers when the distance of 
each vertex from the heights intersection is -jL. In order to allow stationary 

transformations with this embodiment, each unit in layer S should have the same 
distance from its counterpart in layer S+3 as from the closest 3 units in layer S+l. 

[0131] Note that some energy will be required for a dipole to change position 
because of the elongated nature of the dipole. This elongation along with the 
nonlinear nature of dipole-dipole interactions allows local competition, a trait 
important for topology conservation and fundamental to a transformation engine 
according to a present embodiment of the invention. 

[0132] Each unit in layer S must have the same distance from four other units, 
one in layer S+3 and 3 in layer S+l. This condition imposes the following distance d 



J1 2 2 
(-^=r) + d . The distance between layer S to S+l is d and 

therefore the distance from the counterpart dipole in layer S+3 is 3d. The distance to 



each one of the closest units in layer S+l is by Pythagoras ^(-^L) 2 + d 2 . From this 
1 

equation d = . — = 0.204 and the distance between the closest units is therefore 
V24 



R = 3d =0.6124. 

1 

[0133] An important value is the ratio Q = — ^-that is an approximated ratio 

between the forces of closest units within layer S and between each unit in S and each 
one of the 4 closest units, 3 in layer S+l and one in layer S+3. 

[0134] Q = iy^. This high quotient implies that most of the influence on 
each dipole comes from interactions between adjacent layers. 
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[0135] Another issue addressed by the transformation engine resolution. In 
particular, if the transformation is stationary then the layers resolution is only ^ in 

the case where the transformation includes all the layers. This fact implies an 
emergent property of the triangular structure of the dipolar transformatron; different 
levels of transformations use different paths. A collision between two paths may be a 
sign that there is a contradiction in the mapping process and therefore an AC signal, 
even if the induced dipoles are quick, will lead to a welcome instability. 

[0136] As mentioned previously, preprocessing may be performed on the 
values associated with the input pattern and the memory pattern. For example, 
preprocessing may be performed to replace the ACCGTGGA sequence for DNA 
comparison with a logical "1". The complement of the ACCGTGGA sequence is a 
CCCTGGCACCTA sequence because the ACCGTGGA sequence may bind to the 
CCCTGGCA sub-string. Preprocessing may be performed on the CCCTGGCACCTA 
sequence to replace the sequence with a logical "0". The preprocessed values may 
then be inserted into the appropriate layers. 

[0137] Another embodiment of the invention provides a Transformatron 
model in Riemannian Geometry. In contrast to the prior embodiment implementing a 
Far Span K - Distance Connections, the following embodiment uses covariant 
generalization in Riemannian geometry and thus allows complex matching between 
low dimensional patterns which is more difficult in Euclidean geometry. 

[0138] As was described above in connection with the first embodiment, a 
transformation between boundaries, memory layer and input layer (e.g. ellipse drawn 
on the plane x,y,0 in R 3 as p(xeHip S e,yeiiipse,0)=l and 0 is elsewhere in the plane where 
the ellipse curve is not present and between a circle drawn on the plane x,y,l) can be 
done such that an intermediate pattern on the intermediate plane x,y,0.5 will emerge 
(e.g. an ellipse that is an intermediate pattern between the ellipse on the plane x,y,0 
and between a circle on the plane x,y,l in R 3 ). This is done by defining a local cost 
function such that minimizing that local cost function causes a potential function p to 
be defined throughout the entire region between the boundaries. This method is used 
in order to match patterns by a later step that was named, "vibration waves". 
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[0139] By matching through curved space, more complex matching tasks can 
be successfully achieved as curved geometry allows parallel lines to exist between the 
input pattern and the memory pattern even if in flat geometry this task is impossible. 
For example one can imagine parallel straight lines connecting a circle on x,y,0 plane 
with a circle drawn on the x,y,l plane. If instead of circle, an eccentric ellipse is 
drawn on the x,y 5 0 plane then one can't match between the ellipse on x,y,0 and a 
circle on x,y,l by using only straight parallel lines. This task, however, can be 
achieved if the space itself is curved as defined in Riemmanian geometry. Further, 
the minimum energy function has a formalism such that the Euler Lagrange operator 
of the minimum energy function yields tensor densities. As a result, the matching 
process is stable in curved spaces. This minimum energy function can further be used 
as computational basis for the development of new theories in physics. 

[0140] The modification to the minimum energy function used according to an 
embodiment of a method of the invention may be described as follows. In 
Riemannian geometry language the minimum energy to be minimized can be written 
as 

(K,P i P i + 

K ( (P r ;^P s ;,)(PL;,-P k ;.)g"^^ , (P^UQP'Pj^g-* 

AT 3 ( (pAp \ )>mPW ) 2 + 



P'P 



4± 



g 



Where: g is the determinant of the metric tensor, upper indices denote contravariant 
tensor property, lower indices denote covariant tensor properties, P. denotes a 
BP 

gradient P i = — r of a gradually changing function P , That changes between the 

dx l 

memory and input layers, {-d < x x < d-d < x 2 < d,...x J -d <x n < d) , 

(-d <x } < d-d < x 2 < d y ...x J +8 ,...,-d < x n <d) (when n is the dimension of a 

Riemannian manifold and d > 0 is a very large in relation to 8 > 0 ) Semi colon 
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denotes a covariant derivative and comma denotes an ordinary derivative, 
dP 

P , . = — '- . R denotes the scalar curvature also known as Ricci scalar. 

tJ dx J 

K i ,K 2 ,K 3 , K 4 denote constants of the model. 

[0141] The reason to include the curvature R as cost function is in order to 
penalize curvature which means that matching between patterns will not be at any 
cost but rather will be also regulated when curvature also costs energy. 

[0142] According to the earlier described embodiment, the energy function 
that was minimized was: 



S((E(^ P >i) P ^(Z(^r P ^^)) and in Ml tensor ^nguage 
tt 7^ 5x tt 3x 

P s P r ; s P s P r ; s . This minimum energy function is applicable only in flat space and it's 
Euler Lagrange operator does not yield tensor densities. 



[0143] A thorough explanation for the theory is as follows. As described 
above in connection with the previous embodiment, the Far Span k - Distance 
Connections has both digital and continuous forms. The continuous form of the 

energy described above may be expressed as <=1 ' =1 /=1 when 

upper indices are x coordinate indices and not powers and n is the dimension of the 
compared memory and input patterns and K is constant or changing in a relaxation 

process . In tensor form the function may be written as + ^ ^ 'J** ^Vs" 

pJpt. p L p- 

when '<* nL was the continuous local form of the Far Span k -Distance 
Connection. Semi colon denotes the covariant derivative and indices of P denotes the 
pattern function that is known on the memory layer and on the input layer. Also, 
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j ~ ~ P J P* ' P P.' 

d* J . 9J i>l has several problems significantly including a numerical 
instability of the matching between the memory and input layers. 

[0144] To address these problems, we can define the Far Span k - Distance 
Connection as a minimum energy function that depends on the second order 
derivatives of a pattern P that is defined on two boundaries, with upper indices 
describing coordinate indices and not powers, boundary 
{-d < x l < d-d < x 2 < d,...x J d <x" <d) and boundary 

(-d < x l <d-d <x 2 <d,...x J +5,...,-J <x n <d) (when n is the dimension of a 
Riemannian manifold and d is very large in relation to 8 ). 

[0145] This is in contrast to the prior definition of the domain, 

{-d < x l < d-d < x 2 < d 9 ...-d <x n <d) 
and the boundaries 

{-d <x 1 <d-d <x 2 < d,...x J d < x" <d), 
(-d <x ] < d-d < x 2 < d,...x J + 6 ,...-d < x n <d) 
Referred to an Euclidean space, e.g. R 3 . 



[0146] If one boundary (-d <x l <d-d <x 2 < d,...x J d <x n <d) 
contains a pattern drawn as p and the other boundary has another definition of p we 
called (-d < x x < d-d < x 2 < d,...x J - d < x" < d) , memory layer and input layer. 
We then tried to connect the pattern p on both layers by the vector field which is 
generated by the gradient of this field p such that the gradient of p will form a vector 
field on the domain {-d <x x <d-d <x 2 <d,...-d <x n <d) between the memory 
layer and the input layer and such that the gradient of p will form curves as parallel 
and as straight as possible. 

[0147] Transformations between p that is defined on the input layer and 
pthat is defined on the memory layer need not be linear, e.g. a transformation 
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between two hand written signatures defined on two parallel planes x 9 y,0 and x,y,l 
as p * 0 for ink dot and p = 0 for blank paper. 

[0148] The restriction of matching between such two patterns in Euclidean 
space doesn't make any sense because in curved space matching can be easier to 
perform. 

[0149] The reason is that if parallel Gradient(p) = — *-r for all i will not 

d x l 

always be able to form parallel curves in Euclidean spaces but will be able to form 
parallel geodesic curves in curved space and thus allow a method by which a wider 
range transformations will be covered by the disclosed method. 

[0150] The geometric motivation for extending the method may be explained 
as follows. A problem is that, given two Gaussian coordinate boundaries, 

{-d <x ] <d-d <x 2 <d,...x J ,...-d <x n <d), 

{-d < x 1 < d-d < x 2 < d,...x J + 8 < x n <d) (when n is the dimension of a 

Riemannian manifold and d is a very large in relation to 5 ) and a scalar field 
P which its P 2 values are known on these boundaries, and so is the geometry of the 
boundaries as geometric objects is also known, and 0 < P 2 < 1 , on each one of the 

dP 

boundaries, define a Lagrangian such that the integral of (P 1 ^)" 1 s.t. P. - — r when 

8x l 

the power m > 1 will be globally minimal under the conditions: P 2 > e 2 for some 
minimal value s 2 and |p. | 2 < L 2 , for some maximal value L 2 . Here upper indices 

denote the contravariant property, lower ones the covariant one and x 1 denotes the 
coordinates. The problem is also known as optimization of Homotopy. See, e.g., 
Victor Guillemin, Alan Pollack Differential Topology, Homotopy and Stability, pages 
33,34,35, ISBN 0-13-212605-2. Surprisingly, minimizing Lagrangians that involved 
only first order derivatives of the scalar field P did not accomplish the required global 
minimum. 

[0151] An interesting problem is to assign the root of the Ricci scalar (see 
David Lovelock and Hanno Rund, Tensors, Differential Forms and Variational 
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Principles 261, 3.26, ISBN 0-486-65840-6) to P or in pattern recognition language, 
to use the Ricci scalar to encode two compared boundaries on which a geometric 
pattern is known. Intuitively speaking, the problem quite resembles comparing two 

hand written signatures such that each signature is etched (as the Support p * °) on a 
two dimensional plane and two planes with such signatures are parallel at distances 
one from the other, 

{-d < jc 1 < d-d < x 2 < d 9 ...x J \...-d < x" <d), 
{-d <x l < d-d < x 2 < d,...x J + 5 < x n <d). 

[0152] A good matching between these two signatures will be achieved by a 

vector field that can be interpreted into curves connecting the two planes. If 

for example one signature is an ellipse and the other one is a circle then checking the 

p 

intersection of the field * with the intermediate plane, 

8 

(-d < x l < d-d < x 2 < d,...x j + — < x" < d) .„ - - „. 

2 will be also an ellipse with 

eccentricity half the one of an ellipse which is defined by P * ^on, 
(-d <x l < d-d < x 2 < d 9 ...x J + 5 < x n <d), 

[0153] Surprisingly, according to computer simulations, in order to achieve 
such a field as a result of Euler Lagrange equations and of the calculus of variations, 
derivatives of the vector field P ( must be used. Using the well known covariant and 
contravariant indices notation of modern Riemannian Geometry, interesting candidate 

fP^P ) P m 

Lagrangians for exploration are L = ( ) 2 when semi colon denotes the 

Covariant derivative and g denotes the determinant of the Metric Tensor. An 

alternative is L ■ + < P ^>- *" yjj . 

p.p. p.p. ; ^ 

The latter is suitable for yielding a meaningful theory also when P, is not a gradient 

(P r ;,-P s ; r )(P L ; t -P k ;,)g^P* 
of some scalar field p when possibly j 
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[0154] As we found out in low dimensions, a stabilizing Lagrangian is the KG 
operator »" and a meaningful theory is to minimize an integral of the form, 



a 



K x P t P l + 

K (P r ; 5 -P s ;J(P L ;,-P k ; L )g^ J ^ (P A PJ, ni (P'P,), t 

2V pip^ pip^ 

3 P'P ; 



(see, U.S. Patent Application No. 10/144,754, Apparatus For And Method Of Pattern 
Recognition And Image Analysis) for some constants K ]7 K 29 K 3 . . 

[0155] When g denotes the determinant of the metric tensor gy and semi 
colon denotes the covariant derivative and comma denotes an ordinary derivative as 
commonly used in differential geometry. 

[0156] It appears that minimizing the term that involves only the field p t is 
responsible for minimizing the field intensity between the two boundaries and 
minimizing terms that involve derivatives of the field, such as P x \j is responsible that 
the field p will not lose geometric structure as it changes from the boundary, 

(-d <x l < d-d < x 2 < d,...x j - d < x n <d) to the boundary, 
{-d <x x <d-d <x 2 <d,.,.x J +S,...,-J < x" <d). 

It seems that for fields that are the gradient of some scalar function (conserving fields) 



minimizing, nV ' J is sufficient. 

[0157] The theory and method that will unfold is of purely geometric meaning 
and with typical Riemannian formalism. The Lagrangians result as described below. 

[0158] The Transformatron theory can further be explained as follows. Let us 

dg . dP i 

consider a specific Lagrangian of the form L(g^ y , — ^- , P l , — —) (1) 

dx m dx m 

Such that is our local coordinates system. 
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is the metric tensor and P 1 is a contravariant vector field. 
From now on semi colon V will 1 denote covariant derivative and comma V will 

dP l 

denote ordinary derivative as in the following examples, P\.= r , 

dx J 



BP* F * 

P i \j = — - + r k 'jP k when k J are the Christoffel symbols 



We can now write a simple Lagrangian 

;, k -V v ; L )g rL P s P k 
P'P, P'P ; 



(2) 



( (PXUP1 )2 

P ,P i 

The motivation for (2) is explained in further detail below. 



[0159] Definition 1: The Lagrangian (2) is the Riemannian Far Span k 

L=< (p y" >'VF 

Distance Connection. The term 1 turns out to be very useful in 

high dimensional pattern matching tasks in the field of analog computation and visual 
analysis. 

[0160] Minimizing this term means that the square norm of the field Pj along 
it's curves stays as stationary as possible. In directions perpendicular to the field P., 

the field intensity is allowed to change. This is why (2.3) is a preferable Lagrangian 
for describing a field related to matter. An example of a real problem is two parallel 
R 2 boards in R 3 on which an image is encoded using an electric field. 

[0161] One board encodes a memorized image and the other encodes a new 
input. The boards are divided into tiny pixels such that in the middle of each pixel 
there is an electrode. The potential of the memorized image pixels is positive and the 
potential of the pixels of the input image is negative. Between the two boards needle 
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shaped pieces of conductive material are suspended in liquid. These needle shaped 
pieces are coated with non-conductive spheres of polyethylene. 

[0162] Since dipoles respond to the gradient of the square norm of an electric 
field, the needles will align such that this gradient will be minimized along the 
direction they point to. L doesn't exactly describe this machine but is basically 
designed as a result of the same general topological idea. 

[0163] Please note that (2) uses first order derivatives of P g9 providing 
P. = ^fpU i for pattern density p . 



( 



P'P 



(P t , s -J> s , r )(? L , k -P k , L )g rL P°P k 



( 



P'P ; 



-)yfg = 

-)4s 



(2.1) 



Definition 2: The Lagrangian (2.1) is named Angular or Curl deviation. 



L = 



(P A P,), m (P*P s ), k g 



P'P 



mk 



: 



(2.2) 



Definition 3: The Lagrangain (2.2) is named, Forward Deviation. 

[0164] Another form is Forward Deviation for Conserving Fields. 



( 



P'P; 

The equation 



K^P' + 



-) 2 Jg (2.3) 



(P r ;,-P s ; r )(P L ;,-P k ; L )g r VP* , (P^), m (P s P s ), k g 



K 2 ( 



r mk 



P'P; 



P'P 



") + 



(P*P X ), M P' 2 
P'P 



(2.4) 



is also referred to as a Transformatron. 
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[0165] The present embodiment can be summarized by the flow diagram of 
Figure 17 in which new step 1701 is performed following loading of the memory and 
input patterns and is followed by use of vibrational waves as described in the prior 

embodiment. A possible constraint is presented later. If » is a gradient of some 

K P 
scalar function then in (2.4) ^2 can be 0. Conversely, if ^ is not a gradient of a 

K 

scalar function then 3 can be 0. 

In any case K 2 = 0 yields a more stable theory. 

[0166] A difficult question is whether K 4 = 0 yields a flat geometry theory. 
K 2 (or K 2 ) is a result of optimization of Uv'P^^dQ, , for some rn>0, by (2.3) and 




n 

is determined by knowing . 8 is the determinant of the metric tensor in space-time, 
R is the Ricci scalar field and Q is a domain of the form, 

(-d <x l < d-d < x 2 < d,...x J - d < x n < d) , 
{-d <x x < d-d < x 2 < d,...x J + 8 ,...,-</ < x n <d). 

[0167] Clearly (2),(2.1),(2.2) are scalar densities (see, David Lovelock and 
Hanno Rund, Tensors, Differential Forms and Variational Principles page 113, 2.18, 
and the transformation law in page 114, 2.30, 4.2 The Numerical Relative Tensors, 
ISBN 0-486-65840-6) Additional constraints may be also required to define a unique 
solution. 

[0168] A thorough differential geometry discussion on how to reach (2.1) and 
(2.2) is included hereinbelow. However, a difficult and important open problem is 
whether there is an operator of the form, 



s.t. P = VR , the root of Ricci scalar and P s = (Vr ), s , such that the forth order Euler 
Lagrange operator of L will yield a tensor with a new physical meaning. Until now, 





(2.5) 



25396858.3 



51 



Attorney Docket No. 697.004 CIP 



PATENT 



attempts did not succeed to prove that there is such a non-trivial tensor in which third 
and fourth order derivatives of the metric tensor do not vanish. The significance of 
that open problem is due to section 7 and the introduction because structure 
conservation cost and curvature may yield a purely metric classical theory. The 
failure is partly due to lack of clear mathematical theories on Lagrangians with order 
of derivatives of the metric tensor which is higher than 2. (2.4) is defined as a 
Transformatron problem if the Ricci scalar 

p = Vr is known on two three dimensional boundaries, 

(-d <x l <d,-d <x 2 <d-d < x 3 <d,x 4 ),(-d < x l <d~d < x 2 <d-d < x 3 <d,x 4 + 5) 

[0169] We proceed with the purpose of showing that the Euler Lagrange 
operator of (2.4) yields tensor densities. 

The forward deviation may be addressed as follows. We will calculate Euler 
Lagrange operators (see, David Lovelock and Hanno Rund, Tensors, Differential 
Forms and Variational Principles page 323, 5.2, Combined Vector-Metric Field 
Theory, Page 325, Remark 1, ISBN 0-486-65840-6) in order to prove that they yield 
tensor density and thus the model is a feasible physical model. 

EU(L g g ) = -^ — f dL (3) 

d gfiv dx m dg^ v , w 

(P*PJ, m (P*P z ), k r- 
L ~ ^ V * 

//p v 7 m 



dL _P"P V Z 



= 2( r *. )VF s.t.Z m =(?%), j (4) 



We now calculate, 

d dL _ 

dx m dg^ v , m ~ 



^ ((P"P v Z m ); m -P i P v Z m r i " m -P"P i Z m r i v m ) r 
" 2 pTp- \P) 



| jp" p v z m xp r p r ), m 4i 



(p'Pi) 2 
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In which the term 

^p i p v z m r; m -p fl p i z m r i v m (6) 

spoils the tensor density character of (5). 
Please note the following: 

^ = r.WF (7) 
dx m 

Please also note, 

P"P v Z i T i m m 4g= P"P v Z m T m l i^ = P"P V Z' 



dx m 



(8) 



Which led to the first term in (5). We continue calculating, 

8L 
dg My 

' P"; m P v Z m +P"P v ; m Z m -r i M m P i P v Z m -Y, v m P"P i Z m x 
_ ...... p, p _ 



(P^P,), m (P'P, ), k {g-'g" -^g m "g^) 
P^ 

(P a P A ),.(P'P.Xkg" t 



(P'Pi) 2 



m mk 



l (P x P,),n, (P'P. 
2 P'P, 



(9) 



Please note 

^r = g mv g t,k -\g m "g vk (10) 

So the non-tensor components of (5) are the same as in (9) which assures that the 
following is a tensor density, 
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dL d dL 
dg MV dx m dg„ v , m 

( z P t '; m P v Z m +P f 'P v ; m Z m -Y? m P l P v Z m -Y" m P"P'Z m ^ 
(P*P A ), m (P*P,), k (g mv g Mk -\g mM g*) 



p'p. 



(P P/t)'m (P Pj)'k pn pv _|_ 

(P'Pi) 2 

1 (P*P i ). 1I1 (P'P,), k S"' ^ 



P'P 



2 ((P"p v z m ); m -p i p v z m r i " m -p»p i z m r i v m ) | 

p'p. 



+ 2 



(P"P v Z m )(P r P r ), 
(P'P,) 2 



In which the terms J * ~ J ' r m J J " 1 ' ' m cancel each other which clearly 



-p i p v z m r i " m -p"p i z m r; m 

shows (1 1) is a tensor density. 

We continue calculating the other Euler Lagrange terms, 



(ii) 



g__ 2 (P*Z-+P-Z') Vi ; 2 

P'P; ^ 



d dL 
dx v dP„, v 



-2 



((P M Z V + P v Z"); v -Y i M „P i Z v -Y i \P v Z') 
pip 



VF+ (13) 



+ 2 



(P^Z" + P"Z") /ni 



(P'P) 2 



(P'P,),, 
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dL 
dP„ 



(P M ; V Z V -r t "tP'Z l ) 
P'R 



4i- 



(14) 



-2 



(P*P,), m (P'P,), t g 
(P'Pi) 2 



Adding (14) and (13) we have 



dL d dL 



dP M dx v dP M , v 



(P»; v Z"-r i " k P i Z k ) r- 

p'R ^ 8 



? (P^)„(P'P J X t g- t p/ , /- 



((p^z" +p v z /i );,-r,/ y ,P'z l/ -r, M vP ¥ z') 



P'R 



(P"Z" +P"Z") 



(P'pj) 2 



(p'Pi^VF 



(15) 



Clearly (15) is a tensor density because: 

-4r,. / '*P'z* =-2(Y i M v p i z v +r i " v p v z i ) 



(16) 



By (1 1) and (15) that we have proved, the Euler Lagrange operators of (2.2) is indeed 
a tensor density. 

Angular/Curl deviation is addressed as follows. We will calculate the Euler Lagrange 
operators for 
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(p r , s -p s , r )(p L , k -p k , L )g rL p s p k 



P'P: 



Obviously 

u &\xv ->m 

We continue with 
dL d ,(P r , s -P s , r )(J> L , k -T> k , l )g rL g sZ g kU P z P u 



•C 



We continue by calculating, 

rL „sZ kU 



We continu 

d(g rL g' z s ku )p z p L (p, , - p s , r )<p L . k - n., ) 



oVi 7 (18) 



//V 

-\g r "g VL )g' Z g W PzPu(Pr. S -P S .r)(P L > k -P*.J + 
g rL (g SV g" Z -\g S "g VZ )g kU P Z Pu(Pr, s -Ps,)(P L , k ~P k >J + 
g rL g SZ (g h, g" U -\g k "g VU )P Z Pu(P,s -P„r)(P L . k ~P,,l) = 
(g^g" 1 ' -\g r "g V ')P S P k (P,s -P,r)(Pu k -P*.l) + 
(g S "P> -\g S "P")P k g rL (Pr„ -P..,HP L .k -Pk.J + 
(g^P" -^P'JP'g^Pr.s -P..r)(PL« -P k >L) 



(19) 



So we can write, 
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It will be recognized that (20) is a tensor density. 
We continue by calculating 



SP P'P. 



We may write 

2( — = 2 ^-VS (22) 

It should be apparent that 
B" v = -B v ^ (23) 

which is of crucial importance as will be apparent. 
We continue calculating, 

d dL 

dx m dP^, v ~ 

-2( B -" B _ r ^ )VF + (24) 

^ F\P v P k -F\P*P k , / - 
( (P 1 ?^ ' v ^ 

By (23) we have 
B*T/ v =0 ^5) 

So (24) reduces to, 

d__dL L _ 

dx m dP u , 



F\P V P k -F\P»P k r- 

( (pip;) 5 ^ i} ' v ^ 

which is obviously a tensor density. 
We continue calculating, 
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dL d ^F r k P z P u g"g ku 



dP dP 



P'R 



)4s = 



F."F r k P k + FF r "P s 



(— 



P'R 



sz n ku 



-2(- 



F rs F r k P z P u g"g 



(P'Pi) 2 

Adding (27) and (26) we have, 



(27) 



dL 



dL 



dP u dx v dP u , v dP 



ru pS 



P'R 



F r "F r k P k +F rs F r "P 
P'R 



F F r t P P s"z ku i— 



(p'Pi) 2 



i 



2( 



F\P v P k -F\P»P k 



(P'Pi) 2 



(28) 



(28) is a tensor density. So we have proved that the Euler Lagrange operators of the 
Angular (or Curl) deviations yield tensor densities as required by physics. We 
therefore can consider (2.3) as a possible theory. 

[0170] To address the forward deviation for conserving fields we calculate 
Euler Lagrange operators (see, Lovelock et al., supra) in order to prove that they yield 
tensor density and thus the model is a feasible physical model. 



EU(L g MV g MV , m ) = 



dL 



dL 



dg„v dx m d gilv , 



(29) 



L = ( 



P'R 



O 2 ^ 



3L =2{ ^PL ) l^Pl^ (30) 



dg MV , m P'P f 
We now calculate, 



P'R 
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d dL 
dx m dg MV , m 



^(p a pj, s p s AP"p v p m ); m -p i p v p m r i " m -p"p i p m r; m ) 
- 2 < piP; ) ^ + 



(3 



?f (P'PJ,.P' (P'P'P-) r- 



In which the term 

- p i p v p m r i " m - p M p i p m r i v m (32) 

spoils the tensor density character of (31). 
Please note the following: 

Hf-r.Wi 03) 

Please also note, 

P Kp-p'Y. m m Jg = P"P v P m r m l iJ^ = P"P V P m ^S. (34) 

Which led to the first term in (31). We continue calculating, 

dL 
d S MV 

r r W (? *?x),sP\P f '> m P v P m +P"P v ; m P m -T i " m p i p v p m -r; m p fl p i p m 

2( : ) : : - 

p'P p'p 



2^ (P P^)>8 P \ (P P/tXm^ pfi pv + 
P'Pj (P'P,) 2 



1 / (P P/t)>m P \1 ]iv 
y2 K P'^ " ' S 

(35) 
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So the non-tensor components of (31) are the same as in (35) which assures that the 
following is a tensor density, 



dL d dL 




p \ pM '>mP v P m +P f 'P v ; m P m -r i " m p'p v p m -r i v m p tt p i p m ^ 
P'P; p'pj 




P'Pi (P'Pj) 2 




2 P'P; 




(p pj,, p (p m p p ); m -p p p r, m -p m p p r i m) 
p'pj />'/> 




(p A p,), s i>* (P'P'P-) ( 

pip P'P. 




I (P'PJ.SP* (P"p v p m )(p r p r ), m 

p% (p'Pt) 2 

v J 





(36) 

In which the terms - P i P"P m r i " m - P"P i P m r i " m cancel each other which clearly 

shows (36) is a tensor density. 

[0171] We continue calculating the other Euler Lagrange terms, 



^.^h^L-^L^i (37) 

P'P, P'P, v 
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d dL 
dx v dP M , v 



(P'P,),, P* ^P v ); y -T i \P i P v r- 
pip pip 



_4( P'P, + 



+ 4( (P^Xs^ ) (P^) (p i p) /- 

1 p* Pi v*p,) a ■ v 



5P 



4( P i p ; } Fr V * ' 



(p^) 2 v ^ 



Adding (38) and (39) we have 
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3L d 8L 

dP^ dx v dP M , v 



(P*P,), S P S AP"- tv P V -T l " k P l P k ) r- 

pip pip 



-4 (pAp ^ ),m 2 i?m p^VF+ 



(P'Pt) 



1( (P A PJ, S />' ) (P^P v ); v -r i \P i P v 



4( 



P'P ; 



P'P 



P ,p ^^Tp-Vi 7 - 



{ p«p, V'P,) a V 



(40) 



It is apparent that (40) is a tensor density because the non-tensor terms cancel each 
other. 

[0172] The motivation for the Lagrangian presented in (2) above may be 
explained by first providing a definition for the term "Transformatron". In particular, 
the geometric meaning of the "Transformatron" may be described as follows. 
According to one explanation, the Transformatron functions by "penalizing" the 
Lagarngian for a vector field which is not geodesic, can yield a global minimum of 
another integral under certain restrictions. This penalty (or cost function) in turn, can 
take part of the "job" that Ricci tensor does, which means that our vector field will not 
have to be geodesic but deviation from a geodesic field will have to be "penalized". 
We bear in mind that the term "job" refers to a deep Differential Topology issue 
which is known as Stable Homotopy. See, e.g., Guillemin et al y supra). Moreover, 
the original Transformatron was an image processing device and was implemented as 
a complex triangular grid structure and space was not considered as a continuum. 
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[0173] We continue by repeating the following, suppose we have a scalar field 
P i who's 

values are known on the Gaussian coordinates boundaries, 
(-d < x l < d-d < x 2 < d,...x d < x" <d) 9 
(-d < x l < d-d < x 2 < d,...x J + 5 <x n <d). 

[0174] Now we want to minimize P x P l on one hand and keep the field as 

geodesic as possible in flat geometry. We assume that the Euler Number (see, John 
W. Milnor, Topology from the Differentiable Viewpoint, pages 32-41, ISBN 0-691- 
04833-9) of our vector field P. is 0 in every point of the vacuo. This is a necessary 

condition for the following technique to work ! If our field P. is smooth and doesn't 
posses catastrophic Euler Numbers, then differential geometry tells us that there exists 
an arc length curve x l (s) such that 

dx\s) ^ P l 
ds ^P L P L (41) 

Such a curve is geodesic only if 
d 2 x i (s) „ 



d 2 x\s) ( P< ); d_ xV = 
ds 2 ^P L P L 9V ds 

( pi y pv 

pi. 1 pi pv 

( —riP L P^ v )— — = 

(p L p L y (p l p l ) 2 (p l p l ) 2 

pi- p v 1 p' 

i^-^T- — - £ A P L P L ); v P v ) = 0 (43) 

[0175] If our geodesic field * fulfills the following, 
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F * = P * 

1 9j J " or in other words, is a conserving field, then it is sufficient for the norm of 
the field to be stationary along the curve x ^ because then 

{PiPjg ij )\ m = (/?;. p* + ^ ;« /") = o => p,;. /" = o (44) 

by which it is obvious that (43) vanishes. 

[0176] If we want to construct a cost function term that relies solely on the 
derivatives of the square norm of a vector field then we will have a problem when the 
field is not conserving. 

One elegant way to solve this problem is to look at the following terms, 

^=(P r ; J+ P s ; r )-^= 

^ P ' Pi (45) 

U r =(P r ; s -P s ; r )-f= = (P F , s -P s J^= (46) 

(2.1) is simply U V 4~S (2.2) is simply V r V ' 4~g . 
In the past I used to think that 

or its identical form, 

( (pAp ; i ) p ; p '" ) 2 V r i (48) 

are preferable tensor densities because (48) has a clear topological meaning and is 
more stable in pattern recognition engineering applications. 

[0177] If for example, P ; = J^U,. for some scalar field p then 48 is not 

sensitive to gradiends of p which are perpendicular to the field Pj that is if 




[0178] This is a very useful property because a gradient p' can represent 
structural information and forcing it to 0 causes this information to be lost. 

[0179] The problem is that 
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( 



(P r ;,-P,; r )P r /" 
P'R 



r 7=^-0(49) 



which is not useful if P { is not a conserving field. (2.1) solves that problem. 

[0180] The problem that was left was to show that the Euler Lagrange 
operators of (2.1) (2.2) and (2.3) are indeed tensor densities. That is a critical 
condition for considering such a theory to describe Nature. 

[0181] We can thus conclude that Stable Homotopy need not require 
geodesies to exist but does require to minimize deviations from the geodesies 
properties of the field that describes matter in vacuo. 

[0182] As described, the Energy function which is also described herinabove 
as Far Span k - Distance Connection can be extended to Riemannian geometry in the 
example forms 2.4 and 2.5. Further, the system referred to as the Transformatron can 
be numerically simulated such that the memory layer, the input layer and the domain 
in between will all be described as coordinates of Riemannian manifold and thus 
allow convergence for difficult transformations between the pattern stored in the input 
layer and the pattern that is stored in the memory layer. 

[0183] The above referenced conservation constraint may be explained as 
follows. A natural constraint relates to the conservation of matter and can be 




Adding the constraint (A) to (2) we have 



K^P 1 + 

K ( ( P r^- p sv)(PLu-P k ;.)g r ^ 5 ^ , (P A PJ, m (P'PJ, k g 
2 P S P. " P% 



mk 



■) + 




+ (K 3 +X) 



m 



+ K 4 R 



V 
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In this case the constant ^ can be chosen to be - K 3 and yield a theory in which a 
non-conserving field is not lost or added to vacuo. 

[0184] The present application includes a significant amount of theory and 
derivation of equations. This information is included to assist one skilled in the art in 
understanding the invention in detail. The inclusion of this theory and these 
derivations are not intended or included to limit the present invention. 

[0185] It should be noted and understood that all publications, patents and 
patent applications mentioned in this specification are indicative of the level of skill in 
the art to which the invention pertains. All publications, patents and patent 
applications are herein incorporated by reference to the same extent as if each 
individual publication, patent or patent application was specifically and individually 
indicated to be incorporated by reference in its entirety. 
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